-- Logs begin at Fri 2022-08-12 11:25:42 UTC, end at Fri 2022-08-12 12:41:21 UTC. -- Aug 12 12:10:20.001642 dv-cinder-797970-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 12:10:20.010499 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 12:10:20 2022] *** Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: nodename: dv-cinder-797970-6-iscsi Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: machine: x86_64 Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: clock source: unix Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: pcre jit disabled Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: detected number of CPU cores: 4 Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: current working directory: / Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: detected binary path: /usr/bin/uwsgi-core Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: your processes number limit is 47680 Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: your memory page size is 4096 bytes Aug 12 12:10:20.013086 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: detected max file descriptor number: 2048 Aug 12 12:10:20.013858 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: lock engine: pthread robust mutexes Aug 12 12:10:20.013858 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: thunder lock: enabled Aug 12 12:10:20.013858 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 12:10:20.013858 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 12:10:20.051958 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: Python main interpreter initialized at 0x5581a92329c0 Aug 12 12:10:20.051958 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: python threads support enabled Aug 12 12:10:20.051958 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: your server socket listen backlog is limited to 100 connections Aug 12 12:10:20.051958 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: your mercy for graceful operations on workers is 90 seconds Aug 12 12:10:20.052276 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 12:10:20.052359 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: *** Operational MODE: preforking *** Aug 12 12:10:20.052608 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: *** uWSGI is running in multiple interpreter mode *** Aug 12 12:10:20.052608 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: spawned uWSGI master process (pid: 106030) Aug 12 12:10:20.052806 dv-cinder-797970-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 12:10:20.053341 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: spawned uWSGI worker 1 (pid: 106031, cores: 1) Aug 12 12:10:20.053674 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: spawned uWSGI worker 2 (pid: 106032, cores: 1) Aug 12 12:10:20.053833 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 12:10:20.709968 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 12:10:20.713289 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 12:10:21.797055 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 12:10:21.797055 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: from cryptography.utils import int_from_bytes Aug 12 12:10:21.797761 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 12:10:21.797761 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: from cryptography.utils import int_from_bytes Aug 12 12:10:21.799257 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 12:10:21.799257 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: from cryptography.utils import int_from_bytes Aug 12 12:10:21.799698 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 12:10:21.799698 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: from cryptography.utils import int_from_bytes Aug 12 12:10:24.289645 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 12:10:24.290218 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 12:10:24.290403 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 12:10:24.290759 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 12:10:24.291013 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 12:10:24.291393 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.291716 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.292033 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.292386 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.292739 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.292965 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 12:10:24.293325 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.293408 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 12:10:24.293485 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.293648 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.293742 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 12:10:24.293972 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.294095 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 12:10:24.294229 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.294355 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 12:10:24.294540 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.294744 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.294870 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-6-iscsi {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.295078 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.295171 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.295400 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.295492 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.295721 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.295807 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.296053 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.296145 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.296354 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.296444 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.296692 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.296779 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.296999 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.297100 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.297331 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.297491 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.297891 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.297891 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.298030 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.298210 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-6-iscsi {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.298298 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.298512 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.298594 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.298824 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.298915 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.299135 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.299228 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.299439 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.299523 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.299752 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.299854 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.300054 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.300148 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.300368 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.300451 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.300689 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.300902 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.301092 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-6-iscsi {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.301216 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.301403 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.301525 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.301710 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.301838 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.302019 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.302173 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.302424 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.302513 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.302731 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.302826 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.303036 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.303121 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.303353 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.303491 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.303670 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.303762 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.303971 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.304072 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.304307 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.304684 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-6-iscsi {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.304886 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.304979 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.305199 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.305290 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.305512 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.305610 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.305810 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.305942 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.306112 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.306255 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.306415 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.306567 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.306727 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.306888 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.307025 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.307227 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.307320 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.307538 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.307625 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.308376 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.308477 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.308716 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.309006 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.309110 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.309338 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.309435 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.309586 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.309681 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.309833 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.309954 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.310144 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.310274 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.310459 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.310586 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.310762 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.310908 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.311065 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.311216 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.311368 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.311522 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.311672 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.311777 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.311973 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.312087 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.312273 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.312411 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.312575 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.312759 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.312903 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.313084 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.313214 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.313339 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.313522 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.313608 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.313838 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.313931 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.314140 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.314226 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.314453 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.314545 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.314796 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.314880 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.315079 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.315170 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.315383 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.315468 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.315694 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.315777 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.316001 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.316092 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.316310 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.316405 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.316620 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.316754 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.316958 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.317050 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.317261 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.317351 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.317563 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.317656 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.317871 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.317963 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.318185 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.318276 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.318513 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.318618 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.318814 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.318900 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.319063 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.319148 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.319359 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.319452 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.319660 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.319744 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.319973 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.320064 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.320275 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.320406 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.320578 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.320683 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.320907 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.320992 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.321206 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.321293 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.321508 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.321594 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.321807 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.321900 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.322108 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.322217 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.322410 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.322525 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.322711 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.322809 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.323009 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.323101 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.323311 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.323452 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.324231 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.324386 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.324527 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.324698 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.324863 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.325003 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.325182 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.325323 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.325488 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.325619 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.325795 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.325913 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.326097 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.326207 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.326399 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.326487 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.326713 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.326797 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.327016 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.327113 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.327318 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.327413 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.327632 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.327723 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.327941 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.328036 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.328242 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.328324 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.328573 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.328698 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.328884 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.328991 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.329186 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.329271 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.329498 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.329600 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.329790 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.329956 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.330092 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.330191 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.330403 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.330487 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.330707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.330803 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.331008 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.331100 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.331307 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.331390 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.331606 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.331699 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.331904 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.331996 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.332204 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.332298 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.332502 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.332594 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.332824 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.332909 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.333119 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.333218 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.333430 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.333527 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.333739 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.333823 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.334041 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.334132 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.334345 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.334430 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.334645 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.334730 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.334948 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.335030 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.335257 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.335366 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.335561 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.335646 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.335870 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.335975 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.336174 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.336265 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.336480 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.336571 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.336805 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.336909 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.337128 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.337212 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.337452 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.337536 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.337761 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.337856 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.338071 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.338163 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.338377 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.338460 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.338689 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.338855 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:10:24.338991 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.339123 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.339381 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.339512 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.339713 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.339861 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.340039 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.340177 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.340355 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.340494 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.340696 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.340831 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.341017 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.341153 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.341325 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.341464 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.341637 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.341793 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.341947 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.342083 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.342264 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.342402 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.342554 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.342687 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.342878 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.343019 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.343203 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.343340 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.343515 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.343656 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.343834 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.343989 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.344151 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.344318 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.344449 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.344583 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.344767 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.344898 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.345073 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.345220 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.345391 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.345533 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.345721 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.345851 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.346029 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.346127 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.346343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.346429 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.346649 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.346734 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.346958 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.347053 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.347266 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.347352 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.347580 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.347672 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.347886 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.347980 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.348215 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.348301 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.348527 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.348613 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.348861 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.348948 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.349168 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.349252 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.349482 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.349568 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.349791 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.349880 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.350098 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.350190 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.350405 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.350491 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.350707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.350801 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.351008 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.351101 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.351309 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.351403 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.351614 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.351702 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.351953 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.352270 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.352591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.352929 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.353248 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.353568 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.353880 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.354194 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.354502 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.354911 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.355417 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.355716 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.355835 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.356035 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.356362 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.356714 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.357005 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.357092 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.357349 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.357433 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.357659 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.357758 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.357974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.358060 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.358289 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.358374 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.358602 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.358694 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.358911 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.359006 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.359226 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.359311 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.359541 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.359629 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.359854 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.359939 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.360180 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.360265 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.360490 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.360575 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.360838 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.360923 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.361156 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.361251 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.361466 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.361552 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.361776 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.361868 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.362092 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.362186 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.362402 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.362501 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.362715 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.362800 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.363027 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.363121 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.363338 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.363423 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.363651 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.363734 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.363965 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.364059 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.364276 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.364368 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.364593 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.364751 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.364928 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.365070 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.365254 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.365383 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.365581 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.365724 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.365868 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.366008 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.366196 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.366327 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.366508 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.366641 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.366821 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.366963 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.367124 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.367266 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.367428 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.367557 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.367733 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.367862 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.368038 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.368174 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.368341 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.368489 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.368680 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.368815 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.368978 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.369107 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.369278 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.369420 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.369582 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.369712 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.369886 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.370020 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.370186 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.370810 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.371206 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.371338 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.371604 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.371783 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.371919 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.372163 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.372357 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.372494 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.372828 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.372962 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.373167 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.373490 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.373626 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.373817 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.374135 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.374263 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.374455 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.374698 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.374829 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.375073 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.375323 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.375454 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.375689 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.375937 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.376078 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.376316 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.376533 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.376709 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.376968 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.377164 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.377295 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.377599 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.377729 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.377924 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.378234 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.378368 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.378556 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.378894 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.379037 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.379219 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.379454 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.379541 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.379851 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.380027 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.380166 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.380492 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.380608 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.380842 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.381157 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.381241 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.381471 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.381788 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.381874 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.382110 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.382385 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.382479 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.382733 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.382960 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.383054 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.383357 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.383557 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.383671 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.383993 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.384127 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.384301 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.384618 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.384760 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.384975 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.385304 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.385392 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.385614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.385927 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.386564 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.386966 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.387111 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.387279 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.387467 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.387594 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.387797 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.388092 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.388253 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.388432 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.388517 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.388776 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.388864 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.389092 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.389187 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.389409 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.389504 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.389722 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.389806 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.390035 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.390168 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.390351 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.390444 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.390663 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.390765 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.390972 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.391057 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.391280 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.391363 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.391585 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.391681 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.391901 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.391995 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.392217 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.392300 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.392522 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.392607 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.392860 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.392955 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.393184 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.393268 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.393496 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.393582 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.393804 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.393890 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.394113 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.394196 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.394432 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.394529 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.394739 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.394822 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.395044 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.395127 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.395352 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.395445 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.395660 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.395745 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.395967 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.396062 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.396276 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.396371 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.396590 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.396706 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.396926 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.397013 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.397235 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.397329 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.397538 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.397631 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.397849 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.397935 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.398157 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.398243 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.398461 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.398546 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.398763 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.398849 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.399073 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.399160 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.399386 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.399470 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.399692 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.399778 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.400004 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.400090 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.400322 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.400423 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.400624 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.400746 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.400948 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.401035 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.401266 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.401350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.401630 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.401726 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.401944 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.402029 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.402263 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.402352 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.402577 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.402676 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.402920 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.403148 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.403234 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.403489 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.403581 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.403811 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.403897 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.404126 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.404218 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.404449 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.404542 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.404770 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.404862 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.405082 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.405168 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.405390 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.405488 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.405709 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.405803 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.406021 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.406119 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.406327 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.406412 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.406636 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.406731 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.406946 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.407032 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.407255 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.407340 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.407562 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.407648 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.407872 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.407958 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.408177 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.408269 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.408484 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.408621 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.408813 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.408910 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.409115 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.409240 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.409419 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.409504 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.409727 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.409811 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.410043 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.410282 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.410377 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.410611 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.410703 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.410924 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.411009 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.411241 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.411334 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.411551 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.411640 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.411859 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.411951 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.412164 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.412251 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.412471 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.412556 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.412843 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.412949 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.413150 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.413247 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.413460 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.413546 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.413763 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.413855 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.414066 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.414164 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.414373 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.414471 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.414677 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.414763 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.414980 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.415089 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.415277 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.415364 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.415584 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.415671 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.415885 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.415971 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.416187 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.416283 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.416487 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.416582 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.416813 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.416900 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.417148 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.417237 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.417447 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.417535 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.417751 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.417838 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.418051 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.418136 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.418371 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.418522 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.418676 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.418771 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.418977 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.419062 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.419276 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.419370 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.419577 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.419664 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.419897 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.419981 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.420203 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.420301 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.420523 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.420693 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.420854 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.420985 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.421160 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.421302 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.421472 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.421603 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.421772 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.421902 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.422088 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.422229 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.422374 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.422508 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.422673 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.422804 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.422977 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.423115 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.423288 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.423419 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.423593 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.423734 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.423888 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.424022 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.424185 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.424282 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.424492 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.424575 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.424823 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.424903 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.425130 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.425270 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.425416 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.425549 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.425703 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.425837 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.426004 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.426140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.426315 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.426454 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.426619 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.426750 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.426918 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.427048 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.427217 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.427354 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.427523 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.427665 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.427828 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.427963 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.428123 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.428274 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.428428 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.428578 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.428761 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.428902 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.429068 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.429213 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.429614 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.429745 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.429918 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.430052 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.430217 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.430358 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.430523 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.430654 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.430824 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.430953 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.431128 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.431259 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.431434 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.431567 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.431738 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.431826 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.432041 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.432173 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.432340 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.432469 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.432660 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.433299 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.433573 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.433711 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.433924 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.434052 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.434245 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.434396 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.434568 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.434698 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.434884 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.435026 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.435199 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.435338 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.435516 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.435646 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.435822 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.435965 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.436123 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.436266 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.436417 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.436561 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.436745 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.436876 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.437046 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.437185 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.437347 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.437477 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.437647 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.437777 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.437947 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.438084 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.438245 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.438384 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.438563 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.438700 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.438867 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.439003 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.439167 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.439303 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.439468 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.439604 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.439768 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.439902 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.440082 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.440216 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.440392 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.440527 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.440709 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.440840 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.441028 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.441158 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.441343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.441551 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.441693 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.441827 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.441989 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.442124 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.442269 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.442411 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.442552 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.442692 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.442835 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.442975 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.443140 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.443283 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.443430 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.443571 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.443740 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.443878 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.444042 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.444190 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.444343 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.444473 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.444696 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.444845 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.444983 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.445134 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.445265 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.445399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.445570 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.445705 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.445877 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.446014 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.446196 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.446330 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.446498 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.446587 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.446803 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.446890 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.447109 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.447196 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.447415 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.447500 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.447721 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.447808 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.448026 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.448112 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.448333 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.449162 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.449352 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.449447 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.449777 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.449912 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.450097 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.450193 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.450406 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.450492 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.450714 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.450799 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.451022 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.451115 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.451333 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.451426 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.451635 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.451721 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.451956 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.452054 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.452263 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.452348 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.452561 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.452663 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.452892 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.452994 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.453196 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.453290 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.453504 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.453590 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.453806 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.453893 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.454225 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.454319 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.454535 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.454621 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.454840 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.454925 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.455141 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.455257 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.455450 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.455571 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.455758 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.455886 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.456069 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.456211 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.456379 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.456538 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.456697 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.456885 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.457100 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.457200 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.457414 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.457509 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.457725 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.457817 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.458035 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.458121 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.458339 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.458432 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.458643 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.458727 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.458953 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.459037 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.459274 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.459367 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.459578 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.459663 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.459896 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.459987 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.460184 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.460278 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.460500 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.460593 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.460846 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.460953 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.461167 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.461260 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.461577 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.461670 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.462175 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.462278 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.462349 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.462474 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.462556 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.462622 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.462798 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.462892 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.463108 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.463193 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.463414 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.463506 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.463721 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.463806 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.464073 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.464157 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.464382 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.464587 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.464738 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.464926 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.465012 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.465239 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.465345 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.465561 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.465647 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.465884 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.465978 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.466196 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.466282 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.466498 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.466597 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.466800 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.466893 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.467118 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.467205 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.467436 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.467520 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.467743 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.467826 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.468052 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.468136 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.468373 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.468466 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.468703 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.468808 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.469015 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.469108 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.469321 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.469406 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.469629 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.469722 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.469971 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.470054 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.470278 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.470364 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.470582 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.470679 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.470893 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.471056 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.471210 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.471356 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.471491 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.471635 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.471769 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.471900 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.472075 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.472207 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.472383 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.472518 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.472710 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.472844 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.473013 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.473143 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.473314 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.473445 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.473630 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.473765 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.473929 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.474064 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.474246 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.474377 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.474553 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.474697 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.474869 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.475016 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.475179 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.475315 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.475476 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.475605 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.475781 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.475918 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.476083 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.476246 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.476376 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.476512 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.476677 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.476823 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.476983 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.477070 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.477318 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.477406 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.477623 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.477720 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.477931 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.478025 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.478239 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.478325 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.478558 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.478652 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.478865 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.478950 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.479191 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.479282 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.479502 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.479590 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.479899 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.479987 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.480224 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.480329 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.480541 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.480629 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.480875 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.480961 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.481176 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.481266 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.481484 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.481573 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.481786 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.481872 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.482087 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.482173 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.482387 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.482474 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.482692 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.482779 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.482992 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.483085 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.483292 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.483389 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.483592 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.483820 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.483913 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.484155 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.484242 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.484473 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.484566 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.484813 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.484901 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.485116 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.485204 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.485416 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.485502 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.485718 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.485812 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.486037 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.486124 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.486341 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.486425 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.486659 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.486752 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.486961 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.487048 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.487278 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.487366 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.487590 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.487686 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.487901 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.487988 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.488211 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.488299 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.488520 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.488714 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.488856 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.488943 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.489167 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.489260 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.489479 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.489568 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.489785 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.489870 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.490096 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.490190 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.490406 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.490504 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.490722 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.490809 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.491045 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.491240 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.491387 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.491563 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.491694 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.491874 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.492011 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.492186 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.492317 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.492498 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.492631 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.492840 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.492972 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.493152 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.493291 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.493462 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.493593 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.493771 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.493903 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.494079 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.494211 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.494387 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.494518 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.494710 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.494849 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.495027 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.495157 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.495852 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.495944 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.496178 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.496371 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.496570 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.496718 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.496916 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.497075 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.497213 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.497372 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.497528 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.497660 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.497879 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.498012 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.498191 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.498325 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.498495 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.498626 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.498804 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.498941 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.499116 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.499257 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.499425 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.499557 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.499733 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.499871 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.500042 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.500173 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.500352 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.500507 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.500694 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.500845 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.500981 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.501134 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.501302 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.501439 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.501575 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.501718 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.501876 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.502013 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.502194 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.502434 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.502574 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.502779 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.502911 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.503098 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.503247 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.503416 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.503559 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.503728 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.503864 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.504046 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.504244 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.504388 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.504555 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.504749 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.504907 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.504995 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.505227 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.505321 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.505546 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.505634 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.505859 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.505954 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.506175 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.506259 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.506482 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.506569 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.506785 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.506872 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.507086 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.507181 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.507389 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.507482 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.507693 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.507780 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.507998 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.508098 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.508328 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.508414 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.508651 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.508753 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.508963 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.509058 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.509271 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.509357 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.509575 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.509659 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.509881 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.510103 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.510191 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.510442 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.510574 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.510756 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.510884 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.511619 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.511732 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.511941 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.512030 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.512255 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.512350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.512559 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.512674 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.512915 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.513025 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.513217 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.513317 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.513519 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.513606 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.513830 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.513913 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.514135 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.514228 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.514437 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.514522 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.514738 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.514823 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.515044 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.515131 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.515349 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.515449 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.515652 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.515822 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.515969 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.516102 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.516239 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.516373 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.516549 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.516713 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.516877 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.517008 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.517178 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.517476 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.517608 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.517795 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.517944 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.518087 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.518224 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.518360 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.518494 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.518634 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.518769 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.518933 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.519078 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.519243 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.519380 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.519544 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.519687 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.519851 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.519988 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.520152 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.520297 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.520446 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.520579 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.520786 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.520918 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.521092 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.521232 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.521400 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.521534 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.521718 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.521808 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.522018 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.522119 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.522360 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.522447 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.522669 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.522755 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.522975 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.523070 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.523284 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.523368 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.523589 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.523673 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.523895 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.523989 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.524204 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.524290 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.524522 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.524609 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.524887 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.525078 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.525209 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.525410 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.525529 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.525730 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.525890 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.526061 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.526148 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.526386 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.526481 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.526715 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.526836 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.527020 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.527237 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.527323 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.527559 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.527646 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.527881 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.527968 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.528215 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.528310 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.528520 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.528652 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.528862 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.528947 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.529167 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.529282 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.529475 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.529601 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.529785 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.529924 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.530090 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.530248 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.530396 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.530563 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.530701 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.530887 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.531005 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.531210 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.531310 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.531530 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.531616 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.531854 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.531940 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.532165 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.532259 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.532495 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.532581 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.532839 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.532937 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.533155 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.533302 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.533465 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.533597 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.533779 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.533912 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.534084 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.534214 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.534387 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.534516 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.534691 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.534821 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.534996 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.535134 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.535307 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.535441 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.535613 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.535759 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.535923 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.536065 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.536219 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.536307 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.536532 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.536627 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.536865 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.536950 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.537175 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.537262 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.537483 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.537590 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.537791 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.537876 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.538097 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.538181 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.538403 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.538499 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.538710 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.538795 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.539015 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.539106 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.539322 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.539415 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.539628 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.539760 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.539938 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.540024 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.540244 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.540330 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.540551 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.540654 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.540881 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.540977 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.541178 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.541264 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.541482 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.541567 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.541786 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.541870 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.542099 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.542694 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.542937 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.543172 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.543268 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.543529 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.543640 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.543835 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.543961 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.544137 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.544288 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.544437 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.544605 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.544763 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.544956 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.545063 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.545283 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.545376 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.545604 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.545696 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.545982 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.546078 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.546225 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.546318 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.546524 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.546610 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.546822 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.546907 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.547122 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.547207 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.547426 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.547508 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.547727 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.547833 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.548025 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.548111 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.548323 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.548409 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.548622 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.548726 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.548940 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.549033 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.549265 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.549351 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.549591 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.549677 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.549899 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.549985 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.550216 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.550301 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.550521 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.550615 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.550836 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.550943 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.551144 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.551244 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.551457 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.551548 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.551771 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.551857 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.552079 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.552169 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.552383 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.552475 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.552724 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.552811 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.553030 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.553113 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.553342 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.553445 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.553647 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.553734 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.553954 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.554040 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.554261 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.554607 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.554830 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.554915 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.555150 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.555236 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.555472 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.555559 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.555774 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.555859 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.556098 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.556230 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.556410 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.556517 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.556749 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.556848 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.557064 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.557173 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.557371 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.557467 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.557695 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.557834 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.558543 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.558792 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.558925 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.559136 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 12:10:24.559270 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.559441 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.559746 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.560058 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.560366 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.560704 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.561025 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.561338 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.561665 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.561984 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.562291 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.562614 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.562935 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.563273 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.563581 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.563917 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.564237 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.564548 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.564880 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.565182 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:10:24.565425 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 12:10:24.716005 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO dbcounter [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Registered counter for database nova_api Aug 12 12:10:24.717531 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO dbcounter [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Registered counter for database nova_api Aug 12 12:10:24.737400 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_db.sqlalchemy.engines [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:10:24.740820 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_db.sqlalchemy.engines [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:10:24.744063 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writer thread running {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:10:24.748182 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writer thread running {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:10:24.800507 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.context [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2cc624e5-3553-4a43-9cb3-e1cc814c6191(cell1) {{(pid=106031) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 12:10:24.803977 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.context [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2cc624e5-3553-4a43-9cb3-e1cc814c6191(cell1) {{(pid=106032) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 12:10:24.804588 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:10:24.805101 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:10:24.806670 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:10:24.807436 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:10:24.808459 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:10:24.809731 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:10:24.810287 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:10:24.810491 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:10:24.811988 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:10:24.812485 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO dbcounter [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Registered counter for database nova_cell0 Aug 12 12:10:24.812894 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:10:24.813433 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:10:24.815509 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_concurrency.lockutils [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:10:24.817759 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO dbcounter [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Registered counter for database nova_cell0 Aug 12 12:10:24.817951 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO dbcounter [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Registered counter for database nova_cell1 Aug 12 12:10:24.823785 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO dbcounter [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Registered counter for database nova_cell1 Aug 12 12:10:24.826647 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_db.sqlalchemy.engines [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:10:24.827272 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_db.sqlalchemy.engines [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:10:24.830682 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writer thread running {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:10:24.831429 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_db.sqlalchemy.engines [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:10:24.833133 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_db.sqlalchemy.engines [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:10:24.838580 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writer thread running {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:10:24.841723 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writer thread running {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:10:24.969937 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writer thread running {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:10:24.979995 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO dbcounter [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Registered counter for database nova_cell0 Aug 12 12:10:24.988777 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_db.sqlalchemy.engines [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:10:24.988963 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO dbcounter [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Registered counter for database nova_cell0 Aug 12 12:10:24.993439 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writer thread running {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:10:24.998044 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG oslo_db.sqlalchemy.engines [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:10:25.002660 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writer thread running {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:10:25.390725 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: WARNING keystonemiddleware.auth_token [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 12:10:25.398080 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: WARNING keystonemiddleware.auth_token [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 12:10:25.410560 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: WARNING keystonemiddleware.auth_token [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 12:10:25.418517 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: WARNING keystonemiddleware.auth_token [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 12:10:25.740053 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: WARNING keystonemiddleware.auth_token [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 12:10:25.746535 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: WARNING keystonemiddleware.auth_token [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 12:10:25.751825 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5581a92329c0 pid: 106031 (default app) Aug 12 12:10:25.753907 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:10:25.755079 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Aug 12 12:10:25.755515 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Fri Aug 12 12:10:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:10:25.759008 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: WARNING keystonemiddleware.auth_token [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 12:10:25.766391 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: WARNING keystonemiddleware.auth_token [None req-03fea395-d53a-4aee-bae7-ac27518b45fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 12:10:25.771028 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5581a92329c0 pid: 106032 (default app) Aug 12 12:11:46.830542 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:11:46.831546 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 12 12:11:46.832209 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:11:46.845580 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_api:SELECT=3 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:46.846495 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_cell0:SELECT=3 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:46.847549 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_cell1:SELECT=3 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:46.848336 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:47.718198 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-a5bb9a95-c724-4e05-b6ce-4c98e1cd3600 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:11:47.749832 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-a5bb9a95-c724-4e05-b6ce-4c98e1cd3600 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909323 Aug 12 12:11:47.750727 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Aug 12 12:11:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:11:50.103371 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:11:50.106782 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-9680b420-32b1-4aa0-af53-74272c55bf65 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003309 Aug 12 12:11:50.119728 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:11:50 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:11:50.543419 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-eeef2563-efbb-436e-bc94-6cf7d01fc449 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:11:50.563272 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:11:50.563272 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: warnings.warn(msg) Aug 12 12:11:50.654189 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-eeef2563-efbb-436e-bc94-6cf7d01fc449 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.539765 Aug 12 12:11:50.655174 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:11:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:11:50.669039 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=3 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:50.673359 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell0:SELECT=3 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:50.673359 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell1:SELECT=3 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:50.673359 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:50.884764 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-96b5f869-25c8-4743-b12f-72ecc86f72a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:11:50.889072 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:11:50.889072 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 12 12:11:51.022263 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-96b5f869-25c8-4743-b12f-72ecc86f72a8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.358263 Aug 12 12:11:51.022785 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 12 12:11:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:11:53.370000 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-eeef2563-efbb-436e-bc94-6cf7d01fc449 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:11:53.371644 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-eeef2563-efbb-436e-bc94-6cf7d01fc449 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Aug 12 12:11:53.372255 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:11:54.047977 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-43929106-4009-4ec9-9090-80a543d54538 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:11:54.067244 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:11:54.067244 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 12 12:11:54.169985 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-43929106-4009-4ec9-9090-80a543d54538 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.791441 Aug 12 12:11:54.176782 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:11:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:11:54.183750 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-48003887-b58e-4ea5-869e-db422901e714 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:11:54.186653 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:11:54.186653 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: warnings.warn(msg) Aug 12 12:11:54.305788 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-48003887-b58e-4ea5-869e-db422901e714 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125563 Aug 12 12:11:54.316670 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 12 12:11:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:11:56.651967 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-43929106-4009-4ec9-9090-80a543d54538 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:11:56.653003 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-43929106-4009-4ec9-9090-80a543d54538 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 12 12:11:56.653404 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:11:57.043749 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-da532abf-fe4f-4777-9a8a-c3336888e94a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:11:57.111302 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-da532abf-fe4f-4777-9a8a-c3336888e94a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451335 Aug 12 12:11:57.111887 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:11:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:11:57.124225 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-f17c3b26-c5c7-417c-817b-abf535bd9953 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:11:57.224024 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-f17c3b26-c5c7-417c-817b-abf535bd9953 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103554 Aug 12 12:11:57.244674 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 12 12:11:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:11:59.575607 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-da532abf-fe4f-4777-9a8a-c3336888e94a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:11:59.577212 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-da532abf-fe4f-4777-9a8a-c3336888e94a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Aug 12 12:11:59.577771 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:11:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:00.011820 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-fc819dd3-ad3b-4408-aeb0-22bfb69f9e45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "id": "d3"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:00.084162 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-fc819dd3-ad3b-4408-aeb0-22bfb69f9e45 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498195 Aug 12 12:12:00.085022 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:11:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:00.096919 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-796b8d8e-50f8-4e9a-8c47-14f666772385 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:00.190704 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-796b8d8e-50f8-4e9a-8c47-14f666772385 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097344 Aug 12 12:12:00.191437 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 12 12:12:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:12:02.549839 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-fc819dd3-ad3b-4408-aeb0-22bfb69f9e45 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:02.550836 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-fc819dd3-ad3b-4408-aeb0-22bfb69f9e45 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 12 12:12:02.551238 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:12:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:03.005419 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-800f5a3d-adbd-427d-bf51-88d91bae4cf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:03.089801 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-800f5a3d-adbd-427d-bf51-88d91bae4cf6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531489 Aug 12 12:12:03.090668 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:12:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:03.103242 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-506c2053-fac9-4edd-89e6-9ae29a2982f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:03.195285 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-506c2053-fac9-4edd-89e6-9ae29a2982f5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096474 Aug 12 12:12:03.196182 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 12 12:12:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:12:05.601165 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-800f5a3d-adbd-427d-bf51-88d91bae4cf6 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:05.602451 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-800f5a3d-adbd-427d-bf51-88d91bae4cf6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002584 Aug 12 12:12:05.603001 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:06.034948 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-d2b8ad8f-0ee7-40f1-a432-06f524d55426 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:06.059431 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-d2b8ad8f-0ee7-40f1-a432-06f524d55426 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449925 Aug 12 12:12:06.059976 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Aug 12 12:12:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:12:08.507884 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-800f5a3d-adbd-427d-bf51-88d91bae4cf6 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:08.508909 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-800f5a3d-adbd-427d-bf51-88d91bae4cf6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 12 12:12:08.509313 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:12:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:09.019137 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-8a235a64-1db1-498c-bd9c-aa6a9c7bc613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:09.159252 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-8a235a64-1db1-498c-bd9c-aa6a9c7bc613 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.642501 Aug 12 12:12:09.169985 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:12:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:09.172518 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-31b6892b-af68-4cdb-89a5-3c520bdbb0dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:09.315907 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-31b6892b-af68-4cdb-89a5-3c520bdbb0dc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147121 Aug 12 12:12:09.316571 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 12 12:12:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:12:11.664321 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-8a235a64-1db1-498c-bd9c-aa6a9c7bc613 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:11.665426 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-8a235a64-1db1-498c-bd9c-aa6a9c7bc613 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 12 12:12:11.665823 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:12:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:12.058266 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-6ceeee86-dda4-44e0-b925-86f2ba5e7a5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "disk": 20, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:12.138359 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-6ceeee86-dda4-44e0-b925-86f2ba5e7a5a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466530 Aug 12 12:12:12.138957 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:12:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:12.151081 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-32599bab-1370-4a8d-81d7-80f7241bab7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:12.251819 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-32599bab-1370-4a8d-81d7-80f7241bab7c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104215 Aug 12 12:12:12.252417 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 12 12:12:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:12:14.640339 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-6ceeee86-dda4-44e0-b925-86f2ba5e7a5a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:14.641388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-6ceeee86-dda4-44e0-b925-86f2ba5e7a5a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 12 12:12:14.641788 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:12:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:15.210100 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-bed4e2f5-a304-4df1-9c36-f69d9a3d3df6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "id": "3"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:15.511610 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-bed4e2f5-a304-4df1-9c36-f69d9a3d3df6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.858343 Aug 12 12:12:15.512435 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:12:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:15.525013 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-dfdc46bd-e03c-4806-9ab5-5988a2ca8007 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:15.626115 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-dfdc46bd-e03c-4806-9ab5-5988a2ca8007 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105319 Aug 12 12:12:15.627313 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 12 12:12:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:12:17.997505 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-bed4e2f5-a304-4df1-9c36-f69d9a3d3df6 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:17.998526 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-bed4e2f5-a304-4df1-9c36-f69d9a3d3df6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 12 12:12:17.998934 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:18.438891 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-5c7ac8b1-dd76-4d83-ae7c-7f995589860d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "id": "4", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:18.449716 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:12:18.534667 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-5c7ac8b1-dd76-4d83-ae7c-7f995589860d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529593 Aug 12 12:12:18.537039 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:12:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:18.548000 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-33b3d62b-bd67-43cd-ac87-77dbb8a21516 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:18.639628 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-33b3d62b-bd67-43cd-ac87-77dbb8a21516 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095179 Aug 12 12:12:18.640116 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 12 12:12:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:12:21.029936 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-5c7ac8b1-dd76-4d83-ae7c-7f995589860d admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:21.031324 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-5c7ac8b1-dd76-4d83-ae7c-7f995589860d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001822 Aug 12 12:12:21.031800 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:12:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:21.483937 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-122655d6-1c4f-4d70-99d5-92b3a712ba26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "name": "m1.xlarge"}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:21.490794 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:12:21.566096 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-122655d6-1c4f-4d70-99d5-92b3a712ba26 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.527413 Aug 12 12:12:21.566804 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 12 12:12:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:21.579786 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-ebfa61cb-5b91-4f8a-b401-405359a38e63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:21.680767 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-ebfa61cb-5b91-4f8a-b401-405359a38e63 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104818 Aug 12 12:12:21.696925 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 12 12:12:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:12:40.306887 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-122655d6-1c4f-4d70-99d5-92b3a712ba26 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:40.307934 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-122655d6-1c4f-4d70-99d5-92b3a712ba26 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 12 12:12:40.308358 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:40.696409 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-70128f4a-7937-47bb-a037-f42c49bc7695 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:40.714422 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-70128f4a-7937-47bb-a037-f42c49bc7695 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399763 Aug 12 12:12:40.714949 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Aug 12 12:12:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:12:41.778020 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-122655d6-1c4f-4d70-99d5-92b3a712ba26 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:41.779024 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-122655d6-1c4f-4d70-99d5-92b3a712ba26 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 12 12:12:41.779424 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:12:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:42.296142 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-60bdc844-3c57-433a-966c-3ff76b2c2dba admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:42.302210 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.wsgi [None req-60bdc844-3c57-433a-966c-3ff76b2c2dba admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-60bdc844-3c57-433a-966c-3ff76b2c2dba admin admin] Request method failure captured: Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Accept: application/json Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Accept-Encoding: gzip, deflate Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Connection: keep-alive Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Content-Length: 0 Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Host: 10.222.0.27 Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Openstack-Api-Version: compute 2.90 Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Openstack-System-Scope: None Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: User-Agent: python-novaclient Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Auth-Token: gAAAAABi9kO5ZlNbyqE_xmOBH5fdFAGRfLTprx-dKSlQvFzOHVtZmMfDFV1JAqEmtTL2J9oVQpXbCZICc217MDw2rm23RQhjRpqtthpmrAKNhC5EDC0hVhDpm4aQeLhzoNB7FzUTGZChdcCsvON6Hw7IHtZNFjbKkqY49aY2sIphkF9dM9iRVGA Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Domain-Id: None Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Domain-Name: None Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Identity-Status: Confirmed Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Is-Admin-Project: True Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Domain-Id: default Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Domain-Name: Default Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Name: admin Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Role: reader,member,admin Aug 12 12:12:42.305707 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Roles: reader,member,admin Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e93c7bb262f46249ca80b95c794bf2f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}] Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant: admin Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant-Name: admin Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User: admin Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Domain-Id: default Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Domain-Name: Default Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Id: 1b637f155b514b58ab1c4d9c02381dc6 Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Name: admin Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: method: > Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: exception: Flavor 42 could not be found. Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: action_args: {'id': '42'} Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:12:42.307299 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:42.308471 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.309943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-60bdc844-3c57-433a-966c-3ff76b2c2dba admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:12:42.311231 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-60bdc844-3c57-433a-966c-3ff76b2c2dba admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388426 Aug 12 12:12:42.311231 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Aug 12 12:12:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 12:12:42.317383 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-42b3bafd-3c3e-4f87-be75-518329cfbcb4 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:42.339437 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-42b3bafd-3c3e-4f87-be75-518329cfbcb4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026102 Aug 12 12:12:42.339970 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 12 12:12:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:12:42.350032 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-35e65eb4-a50f-42e4-bfcb-e0a6e9c529cc admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:42.373866 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-35e65eb4-a50f-42e4-bfcb-e0a6e9c529cc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027625 Aug 12 12:12:42.374408 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 12 12:12:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:12:42.384602 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-977d1336-cd5c-4671-a285-b4c898830980 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:42.390701 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.wsgi [None req-977d1336-cd5c-4671-a285-b4c898830980 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-977d1336-cd5c-4671-a285-b4c898830980 admin admin] Request method failure captured: Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Accept: application/json Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Accept-Encoding: gzip, deflate Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Connection: keep-alive Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Content-Length: 0 Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Host: 10.222.0.27 Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Openstack-Api-Version: compute 2.90 Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Openstack-System-Scope: None Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: User-Agent: python-novaclient Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Auth-Token: gAAAAABi9kO5ZlNbyqE_xmOBH5fdFAGRfLTprx-dKSlQvFzOHVtZmMfDFV1JAqEmtTL2J9oVQpXbCZICc217MDw2rm23RQhjRpqtthpmrAKNhC5EDC0hVhDpm4aQeLhzoNB7FzUTGZChdcCsvON6Hw7IHtZNFjbKkqY49aY2sIphkF9dM9iRVGA Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Domain-Id: None Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Domain-Name: None Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Identity-Status: Confirmed Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Is-Admin-Project: True Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Domain-Id: default Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Domain-Name: Default Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Name: admin Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Role: reader,member,admin Aug 12 12:12:42.393974 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Roles: reader,member,admin Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e93c7bb262f46249ca80b95c794bf2f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}] Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant: admin Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant-Name: admin Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User: admin Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Domain-Id: default Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Domain-Name: Default Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Id: 1b637f155b514b58ab1c4d9c02381dc6 Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Name: admin Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: method: > Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: exception: Flavor 42 could not be found. Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: action_args: {'id': '42'} Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:12:42.400281 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:42.401117 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:42.402140 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-977d1336-cd5c-4671-a285-b4c898830980 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:12:42.403229 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-977d1336-cd5c-4671-a285-b4c898830980 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014663 Aug 12 12:12:42.403229 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Aug 12 12:12:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 12:12:43.359958 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-35e65eb4-a50f-42e4-bfcb-e0a6e9c529cc admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:43.361046 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-35e65eb4-a50f-42e4-bfcb-e0a6e9c529cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 12 12:12:43.361461 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:43.882164 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-f911db56-74a9-4e9b-b3ad-ad8290190488 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:43.887394 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.wsgi [None req-f911db56-74a9-4e9b-b3ad-ad8290190488 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-f911db56-74a9-4e9b-b3ad-ad8290190488 admin admin] Request method failure captured: Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Accept: application/json Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Accept-Encoding: gzip, deflate Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Connection: keep-alive Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Content-Length: 0 Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Host: 10.222.0.27 Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Openstack-Api-Version: compute 2.90 Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Openstack-System-Scope: None Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: User-Agent: python-novaclient Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Auth-Token: gAAAAABi9kO7hqqHlAa2KY1w_fZ5Nqy3qAISQOekE6LeYCqoRmsFFlNL1ekMK6vPUmrfBalz_56fUl3QCQtr5_U2uD68MJEGktQXs_OFmHr86afvRmEQsC9PzZ-hXYV551B-px1uCnGday-o9quP0lAQ8OZ9yO5vby6HnL-NErSG0JiCIWL7GTU Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Domain-Id: None Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Domain-Name: None Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Identity-Status: Confirmed Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Is-Admin-Project: True Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Domain-Id: default Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Domain-Name: Default Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Name: admin Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Role: reader,member,admin Aug 12 12:12:43.888906 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Roles: reader,member,admin Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e93c7bb262f46249ca80b95c794bf2f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}] Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant: admin Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant-Name: admin Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User: admin Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Domain-Id: default Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Domain-Name: Default Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Id: 1b637f155b514b58ab1c4d9c02381dc6 Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Name: admin Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: method: > Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: exception: Flavor 84 could not be found. Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: action_args: {'id': '84'} Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:12:43.890399 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:43.891350 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.892614 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-f911db56-74a9-4e9b-b3ad-ad8290190488 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:12:43.893852 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-f911db56-74a9-4e9b-b3ad-ad8290190488 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389991 Aug 12 12:12:43.893852 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Aug 12 12:12:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 12:12:43.899827 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-22c36429-da61-4ec1-af1f-b26d2f8a2c97 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:43.914390 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-22c36429-da61-4ec1-af1f-b26d2f8a2c97 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018021 Aug 12 12:12:43.914901 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 12 12:12:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:12:43.923881 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a017b704-48af-4a47-9967-f05bb76e0703 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:43.940036 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a017b704-48af-4a47-9967-f05bb76e0703 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019494 Aug 12 12:12:43.940556 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 12 12:12:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:12:43.950230 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d0b40006-6720-4a0b-9936-f7dbc4d4147d admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:43.955375 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.wsgi [None req-d0b40006-6720-4a0b-9936-f7dbc4d4147d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d0b40006-6720-4a0b-9936-f7dbc4d4147d admin admin] Request method failure captured: Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Accept: application/json Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Accept-Encoding: gzip, deflate Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Connection: keep-alive Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Content-Length: 0 Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Host: 10.222.0.27 Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Openstack-Api-Version: compute 2.90 Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Openstack-System-Scope: None Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: User-Agent: python-novaclient Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Auth-Token: gAAAAABi9kO7hqqHlAa2KY1w_fZ5Nqy3qAISQOekE6LeYCqoRmsFFlNL1ekMK6vPUmrfBalz_56fUl3QCQtr5_U2uD68MJEGktQXs_OFmHr86afvRmEQsC9PzZ-hXYV551B-px1uCnGday-o9quP0lAQ8OZ9yO5vby6HnL-NErSG0JiCIWL7GTU Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Domain-Id: None Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Domain-Name: None Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Identity-Status: Confirmed Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Is-Admin-Project: True Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Domain-Id: default Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Domain-Name: Default Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Name: admin Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Role: reader,member,admin Aug 12 12:12:43.957081 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Roles: reader,member,admin Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e93c7bb262f46249ca80b95c794bf2f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}] Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant: admin Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant-Name: admin Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User: admin Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Domain-Id: default Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Domain-Name: Default Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Id: 1b637f155b514b58ab1c4d9c02381dc6 Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Name: admin Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: method: > Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: exception: Flavor 84 could not be found. Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: action_args: {'id': '84'} Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:12:43.958534 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:43.959388 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:43.960628 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d0b40006-6720-4a0b-9936-f7dbc4d4147d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:12:43.961823 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d0b40006-6720-4a0b-9936-f7dbc4d4147d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011650 Aug 12 12:12:43.961823 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Aug 12 12:12:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 12:12:44.923453 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a017b704-48af-4a47-9967-f05bb76e0703 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:44.924443 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a017b704-48af-4a47-9967-f05bb76e0703 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 12 12:12:44.924858 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:45.444163 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-a6d95175-f3f2-4840-92ff-25fa0f95a1af admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:45.449973 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.wsgi [None req-a6d95175-f3f2-4840-92ff-25fa0f95a1af admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-a6d95175-f3f2-4840-92ff-25fa0f95a1af admin admin] Request method failure captured: Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Accept: application/json Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Accept-Encoding: gzip, deflate Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Connection: keep-alive Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Content-Length: 0 Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Host: 10.222.0.27 Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Openstack-Api-Version: compute 2.90 Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Openstack-System-Scope: None Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: User-Agent: python-novaclient Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Auth-Token: gAAAAABi9kO8v1vKSJkSxk0TQC-17wHIsJMRZq7GI3RmFa4eeIDi41uCT9JeyrWp_DW46shlBrTYQVQ8qr3W-f0nH92NIcG255CI0cdIuB57sqZyUCEsAOC_46wrLGDEU4amnhaRPwgcEI2xyegPcgnUUhj2H2C9CEoOdh_sw4qNTOwSYBAAoZs Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Domain-Id: None Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Domain-Name: None Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Identity-Status: Confirmed Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Is-Admin-Project: True Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Domain-Id: default Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Domain-Name: Default Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Project-Name: admin Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Role: reader,member,admin Aug 12 12:12:45.451455 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Roles: reader,member,admin Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e93c7bb262f46249ca80b95c794bf2f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}] Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant: admin Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-Tenant-Name: admin Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User: admin Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Domain-Id: default Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Domain-Name: Default Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Id: 1b637f155b514b58ab1c4d9c02381dc6 Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: X-User-Name: admin Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: method: > Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: exception: Flavor 451 could not be found. Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: action_args: {'id': '451'} Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:12:45.452922 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:45.453784 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.455172 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-a6d95175-f3f2-4840-92ff-25fa0f95a1af admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:12:45.456480 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-a6d95175-f3f2-4840-92ff-25fa0f95a1af admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391696 Aug 12 12:12:45.456480 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 12 12:12:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 12:12:45.462718 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-9d64ead5-21b2-40b2-ba3d-ab946804add7 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:45.477832 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-9d64ead5-21b2-40b2-ba3d-ab946804add7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018637 Aug 12 12:12:45.478357 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 12 12:12:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:12:45.488136 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:45.502686 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018531 Aug 12 12:12:45.503223 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 12 12:12:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:12:45.512858 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-d417c5d9-a35a-4e50-8c54-dfd4bea18f7b admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:45.518060 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.wsgi [None req-d417c5d9-a35a-4e50-8c54-dfd4bea18f7b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-d417c5d9-a35a-4e50-8c54-dfd4bea18f7b admin admin] Request method failure captured: Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Accept: application/json Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Accept-Encoding: gzip, deflate Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Connection: keep-alive Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Content-Length: 0 Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Host: 10.222.0.27 Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Openstack-Api-Version: compute 2.90 Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Openstack-System-Scope: None Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: User-Agent: python-novaclient Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Auth-Token: gAAAAABi9kO8v1vKSJkSxk0TQC-17wHIsJMRZq7GI3RmFa4eeIDi41uCT9JeyrWp_DW46shlBrTYQVQ8qr3W-f0nH92NIcG255CI0cdIuB57sqZyUCEsAOC_46wrLGDEU4amnhaRPwgcEI2xyegPcgnUUhj2H2C9CEoOdh_sw4qNTOwSYBAAoZs Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Domain-Id: None Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Domain-Name: None Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Identity-Status: Confirmed Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Is-Admin-Project: True Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Domain-Id: default Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Domain-Name: Default Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Project-Name: admin Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Role: reader,member,admin Aug 12 12:12:45.519591 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Roles: reader,member,admin Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e93c7bb262f46249ca80b95c794bf2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e93c7bb262f46249ca80b95c794bf2f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e93c7bb262f46249ca80b95c794bf2f"}]}] Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant: admin Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant-Id: 9e93c7bb262f46249ca80b95c794bf2f Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-Tenant-Name: admin Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User: admin Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Domain-Id: default Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Domain-Name: Default Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Id: 1b637f155b514b58ab1c4d9c02381dc6 Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: X-User-Name: admin Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: method: > Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: exception: Flavor 451 could not be found. Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: action_args: {'id': '451'} Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:12:45.521149 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:45.522106 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: ERROR nova.api.openstack.wsgi Aug 12 12:12:45.523343 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-d417c5d9-a35a-4e50-8c54-dfd4bea18f7b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:12:45.524720 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-d417c5d9-a35a-4e50-8c54-dfd4bea18f7b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011500 Aug 12 12:12:45.524720 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 12 12:12:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 12:12:46.489051 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:46.490075 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 12 12:12:46.490462 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:12:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:47.019511 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-39383fb4-2a40-4985-aa0d-a65bde74c754 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:47.137641 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-39383fb4-2a40-4985-aa0d-a65bde74c754 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.499973 Aug 12 12:12:47.138185 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Aug 12 12:12:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:48.215049 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:48.216047 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 12 12:12:48.216432 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:48.740274 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-72726c3f-bb08-46c1-abc4-3f55f95aa0dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:48.817033 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-72726c3f-bb08-46c1-abc4-3f55f95aa0dc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.464069 Aug 12 12:12:48.819666 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Aug 12 12:12:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 12:12:49.783677 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:49.785664 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002167 Aug 12 12:12:49.786061 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:12:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:50.314599 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-1842b2bc-100a-463e-8e88-c8daae7f427f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:50.390104 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-1842b2bc-100a-463e-8e88-c8daae7f427f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.462732 Aug 12 12:12:50.390644 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Aug 12 12:12:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:51.356856 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:51.357854 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 12 12:12:51.358247 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:51.875319 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-743bdf08-2f73-4d56-9b5e-f269b0d8a79a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:12:51.943653 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-743bdf08-2f73-4d56-9b5e-f269b0d8a79a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.446378 Aug 12 12:12:51.944200 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Aug 12 12:12:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:12:53.022944 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:53.023963 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 12 12:12:53.024319 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:12:53.542450 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a7678416-acd5-44c5-b610-30985a57b961 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:12:53.563601 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a7678416-acd5-44c5-b610-30985a57b961 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401215 Aug 12 12:12:53.564099 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Fri Aug 12 12:12:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:13:46.690883 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:13:46.691943 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d088eca0-d9b2-4f36-bad2-978a913c6d8a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 12 12:13:46.692366 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 12 12:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:13:46.703017 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:13:47.077087 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-13cb846a-d16b-4469-aca2-ce1728ac6845 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:13:47.098170 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-13cb846a-d16b-4469-aca2-ce1728ac6845 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399647 Aug 12 12:13:47.098706 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Aug 12 12:13:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:13:47.119778 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG dbcounter [-] [106032] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:13:47.123592 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-c9ada4a5-4794-4c50-bd98-125784d58dbd admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:13:47.131180 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-c9ada4a5-4794-4c50-bd98-125784d58dbd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012780 Aug 12 12:13:47.131689 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Fri Aug 12 12:13:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:13:47.142998 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-e98b81b2-dfed-47c4-9cb1-ee47dba9b0bc admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:13:47.150461 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-e98b81b2-dfed-47c4-9cb1-ee47dba9b0bc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011025 Aug 12 12:13:47.150963 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Fri Aug 12 12:13:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:13:47.162794 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:13:47.170669 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011637 Aug 12 12:13:47.174557 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Fri Aug 12 12:13:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:13:47.182868 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-a713257a-cb35-4f69-9014-8b3f0cf61438 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:13:47.190571 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-a713257a-cb35-4f69-9014-8b3f0cf61438 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011109 Aug 12 12:13:47.191078 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Fri Aug 12 12:13:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:16:51.292395 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:16:51.294128 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002912 Aug 12 12:16:51.297450 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:16:51.437054 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=6 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:16:51.597429 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-550affe5-b896-45a6-8ce4-4ba55ee4df14 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:16:51.599747 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:16:51.599747 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 12 12:16:51.600960 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-550affe5-b896-45a6-8ce4-4ba55ee4df14 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:16:51.601437 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-550affe5-b896-45a6-8ce4-4ba55ee4df14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:16:51.601893 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-550affe5-b896-45a6-8ce4-4ba55ee4df14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:16:51.602601 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-550affe5-b896-45a6-8ce4-4ba55ee4df14 admin admin] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:16:51.603047 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-550affe5-b896-45a6-8ce4-4ba55ee4df14 admin admin] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:16:51.603465 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-550affe5-b896-45a6-8ce4-4ba55ee4df14 admin admin] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:16:51.637797 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-550affe5-b896-45a6-8ce4-4ba55ee4df14 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202235 Aug 12 12:16:51.638352 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 12 12:16:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:16:52.468550 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:16:52.469585 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 12 12:16:52.472991 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:16:52.660237 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-2a084815-972c-4891-8237-8ddd2f163b5f admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:16:52.662624 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:16:52.662624 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 12 12:16:52.663709 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-2a084815-972c-4891-8237-8ddd2f163b5f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:16:52.664178 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-2a084815-972c-4891-8237-8ddd2f163b5f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:16:52.664599 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-2a084815-972c-4891-8237-8ddd2f163b5f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:16:52.665357 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-2a084815-972c-4891-8237-8ddd2f163b5f admin admin] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:16:52.665800 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-2a084815-972c-4891-8237-8ddd2f163b5f admin admin] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:16:52.666905 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-2a084815-972c-4891-8237-8ddd2f163b5f admin admin] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:16:52.686791 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-2a084815-972c-4891-8237-8ddd2f163b5f admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077044 Aug 12 12:16:52.687259 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 12 12:16:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:17:03.903725 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:17:03.904754 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 12 12:17:03.905154 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:17:04.050726 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell0:SELECT=4 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:17:04.051585 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_cell1:SELECT=4 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:17:04.052201 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG dbcounter [-] [106031] Writing DB stats nova_api:SELECT=8 {{(pid=106031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:17:04.098057 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-14d76594-e392-4cc7-9176-2404d208c9d3 admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:17:04.100413 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:17:04.100413 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 12 12:17:04.101531 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-14d76594-e392-4cc7-9176-2404d208c9d3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:17:04.103884 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-14d76594-e392-4cc7-9176-2404d208c9d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:17:04.103884 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-14d76594-e392-4cc7-9176-2404d208c9d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:17:04.103884 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-14d76594-e392-4cc7-9176-2404d208c9d3 admin admin] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:17:04.103884 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-14d76594-e392-4cc7-9176-2404d208c9d3 admin admin] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:17:04.104247 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-14d76594-e392-4cc7-9176-2404d208c9d3 admin admin] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:17:04.132585 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-14d76594-e392-4cc7-9176-2404d208c9d3 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082945 Aug 12 12:17:04.132585 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 12 12:17:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:17:04.975251 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: DEBUG nova.api.openstack.wsgi [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] Calling method '>' {{(pid=106032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:17:04.976308 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: INFO nova.api.openstack.requestlog [None req-d2f652bc-e4a5-44a1-9643-4367bc182573 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 12 12:17:04.976883 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: [pid: 106032|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 12 12:17:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:17:05.168516 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG nova.api.openstack.wsgi [None req-d63b8071-8235-42bd-8ac2-4a231225045e admin admin] Calling method '>' {{(pid=106031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:17:05.171100 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:17:05.171100 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: warnings.warn(msg) Aug 12 12:17:05.172195 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d63b8071-8235-42bd-8ac2-4a231225045e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:17:05.172687 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d63b8071-8235-42bd-8ac2-4a231225045e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:17:05.173119 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d63b8071-8235-42bd-8ac2-4a231225045e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:17:05.173831 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d63b8071-8235-42bd-8ac2-4a231225045e admin admin] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:17:05.174276 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d63b8071-8235-42bd-8ac2-4a231225045e admin admin] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:17:05.174723 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: DEBUG oslo_concurrency.lockutils [None req-d63b8071-8235-42bd-8ac2-4a231225045e admin admin] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:17:05.196361 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: INFO nova.api.openstack.requestlog [None req-d63b8071-8235-42bd-8ac2-4a231225045e admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079037 Aug 12 12:17:05.196940 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: [pid: 106031|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 12 12:17:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:18:03.133494 dv-cinder-797970-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 12 12:18:03.134646 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: Fri Aug 12 12:18:03 2022 - graceful shutdown triggered... Aug 12 12:18:03.135077 dv-cinder-797970-6-iscsi devstack@n-api.service[106032]: Gracefully killing worker 2 (pid: 106032)... Aug 12 12:18:03.135498 dv-cinder-797970-6-iscsi devstack@n-api.service[106031]: Gracefully killing worker 1 (pid: 106031)... Aug 12 12:18:04.134606 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: worker 1 buried after 1 seconds Aug 12 12:18:04.134606 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: worker 2 buried after 1 seconds Aug 12 12:18:04.134606 dv-cinder-797970-6-iscsi devstack@n-api.service[106030]: goodbye to uWSGI. Aug 12 12:18:04.136139 dv-cinder-797970-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 12 12:18:04.136719 dv-cinder-797970-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 12 12:18:04.139532 dv-cinder-797970-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 12:18:04.149454 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 12:18:04 2022] *** Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: nodename: dv-cinder-797970-6-iscsi Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: machine: x86_64 Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: clock source: unix Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: pcre jit disabled Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: detected number of CPU cores: 4 Aug 12 12:18:04.151375 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: current working directory: / Aug 12 12:18:04.151991 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: detected binary path: /usr/bin/uwsgi-core Aug 12 12:18:04.151991 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: your processes number limit is 47680 Aug 12 12:18:04.151991 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: your memory page size is 4096 bytes Aug 12 12:18:04.151991 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: detected max file descriptor number: 2048 Aug 12 12:18:04.151991 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: lock engine: pthread robust mutexes Aug 12 12:18:04.151991 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: thunder lock: enabled Aug 12 12:18:04.151991 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 12:18:04.151991 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 12:18:04.191924 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: Python main interpreter initialized at 0x55d5075489c0 Aug 12 12:18:04.191924 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: python threads support enabled Aug 12 12:18:04.191924 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: your server socket listen backlog is limited to 100 connections Aug 12 12:18:04.191924 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: your mercy for graceful operations on workers is 90 seconds Aug 12 12:18:04.192312 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 12:18:04.192380 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: *** Operational MODE: preforking *** Aug 12 12:18:04.192655 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: *** uWSGI is running in multiple interpreter mode *** Aug 12 12:18:04.192655 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: spawned uWSGI master process (pid: 121135) Aug 12 12:18:04.192857 dv-cinder-797970-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 12:18:04.196820 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: spawned uWSGI worker 1 (pid: 121153, cores: 1) Aug 12 12:18:04.197378 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: spawned uWSGI worker 2 (pid: 121154, cores: 1) Aug 12 12:18:04.197726 dv-cinder-797970-6-iscsi devstack@n-api.service[121135]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 12:18:04.866657 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 12:18:04.877857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 12:18:06.035208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 12:18:06.035208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: from cryptography.utils import int_from_bytes Aug 12 12:18:06.035982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 12:18:06.035982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: from cryptography.utils import int_from_bytes Aug 12 12:18:06.042447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 12:18:06.042447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: from cryptography.utils import int_from_bytes Aug 12 12:18:06.042918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 12:18:06.042918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: from cryptography.utils import int_from_bytes Aug 12 12:18:08.373891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 12:18:08.374414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 12:18:08.374672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 12:18:08.375037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 12:18:08.375295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 12:18:08.375697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.376009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.376327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.376663 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.376998 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.377318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.377643 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.377960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.378289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.378547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.378862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.379184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-6-iscsi {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.379508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.379812 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.380121 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.380436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.380763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.381083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.381398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.381894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.382337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.382766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.383279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.383721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.384042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.384356 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.384707 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.385019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.385346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.385654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.386058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-6-iscsi {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.386374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.386686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.386998 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.387419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.387731 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.388036 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.388595 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.388956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.389256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.389589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.389911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.390229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.390551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.390866 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.391161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.391469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.391792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.392094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.392396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.392848 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.393031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.393288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.393605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.393962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.394171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.394420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.394737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.395069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.395363 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.395667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.395972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.396281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.396586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.396914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.397221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.397525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.397840 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.398673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.398993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.399302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.399619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.400022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.400273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.400581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.400949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.401375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.401692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.402013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.402334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.402639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.402943 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.403248 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.403566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.403897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.404202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.404453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.404773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.405079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.405395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.405699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.406002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.406306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.406603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.406905 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.407208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.407510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.407820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.408124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.408425 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.408753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.409058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.409364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.409682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.410005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.410302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.410603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.410906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.411209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.411523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.411825 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.412129 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.412448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.412772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.413074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.413389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.414305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.414613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.414935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.415229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.415325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 12:18:08.415755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.415846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 12:18:08.415930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.416126 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.416225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 12:18:08.416431 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.416533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 12:18:08.416755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.416890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 12:18:08.417059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.417361 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.417459 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.417660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.417751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.417964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.418312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.418519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.418696 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.418811 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.419080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.419184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.419421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.419521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.419725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.419819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.420029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.420144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.420336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.420514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.420666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.420848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.421000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.421234 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.421346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.421586 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-6-iscsi {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.421686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.421940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.422079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.422270 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.422363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.422599 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.422698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.422914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.423017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.423225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.423351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.423538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.423726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.423871 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.424089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.424228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.424470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.424690 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.424820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.425056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.425150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.425413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.425519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.425755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.425845 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.426071 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.426170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.426384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.426531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.426698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.426904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.426995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.427241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.427410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.427627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.427718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.427948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.428040 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.428256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.428357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.428597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.428799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-6-iscsi {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.428962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.429156 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.429324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.429553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.429657 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.429911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.430009 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.430222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.430459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.430567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.430819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.430918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.431138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.431263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.431472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.431599 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.431784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.431883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.432101 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.432275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.432413 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.432603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.432796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.432994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.433101 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.433347 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.433446 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.433658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.433763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.433995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.434103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.434307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.434414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.434651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.434767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.434928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.435061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.435433 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.435602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.435783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.436468 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.436728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.436897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.436897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.437181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.437334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.437478 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.437628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.437787 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.437931 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.438083 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.438238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.438401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.438557 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.438702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.438855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.438998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.439148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.439390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.439550 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.439703 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.439857 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.439857 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.440250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.440413 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.440686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.440851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.441022 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.441127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.441221 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.441314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.441416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.441556 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.441556 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.441868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.442037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.442142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.442228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.442319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.442402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.442491 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.442574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.442680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.443271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.443453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.443549 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.443640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.443735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.443735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.443897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.443897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.444131 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.444214 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.444307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.444428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.444527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.444762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.444860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.445166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.445278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.445482 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.445712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.445804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.446067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.446263 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.446434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.446540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.446705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.446798 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.447023 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.447136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.447342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.447451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.447662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.447765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.447965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.448061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.448215 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.448327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.448529 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.448892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.448892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.449508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.449583 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.449667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.449746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.449817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.449885 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.449966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.450668 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.450860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.451046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.451330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.451480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.451651 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.451954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.452115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.452265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.452409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.452549 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.452843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.453004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.453500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.453652 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.453791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.453926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.454114 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.454387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.454500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.454581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.454677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.454966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.455063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.455135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.455205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.455355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.455493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.455652 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.455800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.455968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.456098 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.456241 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.456392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.456558 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.456671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.456748 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.456818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.456900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.456979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.457220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.457469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.457612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.457754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.457859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.457943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.458023 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.458023 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.458167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.458167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.458320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.458401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.458484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.458484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.458648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.458803 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.458886 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.458966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.459053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.459053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.459209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.459326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.459416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.459697 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.459790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.459955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.460058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.460260 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.460357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.461114 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.461556 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.474757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.474855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.474952 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.475061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.475146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.475235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.475317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.475407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.475489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.475570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.475657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.475746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.475835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.475930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.476012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.476094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.476853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.476952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 12:18:08.477137 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477608 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477780 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.477939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478119 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478367 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478620 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.478967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479151 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479232 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479661 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479764 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.479925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.480985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.481126 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.481251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485164 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485292 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485596 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.485906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486487 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.486916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487495 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487672 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.487922 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488100 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.488974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489113 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.489956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490497 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490614 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.490940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491231 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491451 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491693 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.491977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492118 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492252 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492424 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.492928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493532 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.493975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494054 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.494980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495304 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.495961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.496050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.496144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.496232 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.496322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.496322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.496479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.496572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.503371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.503486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.503572 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.503655 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.503750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.503833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.503913 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.503994 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.504082 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.504164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.504253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.504335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.504415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.504503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.504674 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.504854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505843 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.505931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506490 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506812 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506902 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.506992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.507940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508217 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508309 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.508948 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509232 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509495 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.509923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510118 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.510813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511022 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.511820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.512142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.512353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.512489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.512698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.512958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.513094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.513236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.513373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.513542 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.513695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.513858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.515515 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.515689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.515845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.516018 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.516169 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.516337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.516523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.516705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.516861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.517010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.517160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.517326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.517486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.517486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.517811 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.517960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.518128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.518286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.518444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.518594 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.518749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.518898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.518898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.519204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.519367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.519528 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.519716 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.519878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.520051 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.520201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.520349 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.520505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.520673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.520841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.521157 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.521317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.521467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.521661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.521826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.521990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.522262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.522542 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.522829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.523641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.523810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.523810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.523810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.523810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.525601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.525711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.525805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.525889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526027 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526214 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.526915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527012 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.527989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.532868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.533398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.533398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.533398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.533398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.533398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.533398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.533398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.534777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.534852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.534930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535232 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535310 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535557 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.535709 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.536429 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.536587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.536787 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.536949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.537179 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.537334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.537494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.537494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.537846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.537846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.538154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.538316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.538468 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.538721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.539796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.539796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.540164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.540326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.540487 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.540669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.540828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.540991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.541142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.541390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.541549 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.541712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.541902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.542057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.542207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.542372 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.542525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.542676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.542840 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.542996 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.543415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.543569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.543719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.543869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.544086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.544238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.544397 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.544557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.544732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.544922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.545091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.545243 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.545406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.545558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.545709 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.545858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.546051 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.546216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.546382 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.546533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.546691 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.546843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.546992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.547155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.547314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.547472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.547622 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.547781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.547939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.548152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.548332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.548492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.548660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.548828 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.548980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.549140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.549299 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.549672 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.549934 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.550122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.550279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.550444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.550614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.550766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.550916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.551067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.551225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.551394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.551614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.551769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.551919 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.552152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.552326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.552480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.552629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.552948 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.553112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.553271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.553271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.553579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.553741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.553900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.554156 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.554349 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.554519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.554679 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.554928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.555130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.555308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.555469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.555629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.555780 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.555930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.556086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.556246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.556410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.556568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.556755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.556969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.557134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.557250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.557375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.557496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.557609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.557721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.557831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.557942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558910 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.558910 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.559122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.559233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.559352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.559470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.559808 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.559944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.560058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.560328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.560455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.560568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.560922 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.561095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.561289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.561454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.561632 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.561854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.561854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.562152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.562348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.562514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.562673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.562838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.563001 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.563169 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.563320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.563526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.563687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.563839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.563996 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.564155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.564553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.564752 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.564909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.565059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.565209 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.565359 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.565554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.565721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.565872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.566030 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.566181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.566372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.566533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.566685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.566844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.567168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.567341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.567501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.567716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.567880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.567880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.568192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.568386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.568548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.568834 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.569002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.569002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.569289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.569439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.569597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.570016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.570221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.570483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.570641 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.570800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.570967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.571126 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.571277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.571427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.571584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.571735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.572011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.572177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.572329 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.572490 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.572676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.572841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.573009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.573161 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.573310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.573310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.573603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.573763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.573922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.574088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.574253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.574451 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.574622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.574781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.574931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.575082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.575240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.575398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.575558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.575708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.575894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.576050 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.576201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.576360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.576570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.576746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.576898 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.578208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.578387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.578558 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.578710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.578861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.579019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.579179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.579339 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.579504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.579663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.579846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.580237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.580399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.580707 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.580883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.581036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.581194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.581346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.581503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.581654 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.581817 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.581992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.582224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.582434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.582591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.582766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.582935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.583087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.583238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.583387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.583539 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.583698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.583849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.584000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.584204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.584204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.584497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.584625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.584761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.584873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.584983 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.591255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.591424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.591424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.591722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.591861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.591992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.592137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.592368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.592503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.592656 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.592789 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.592920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.593049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.593197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.593335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.593473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.593610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.593610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.593610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.593987 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.594118 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.594254 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.594384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.594384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.594637 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.594773 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.594912 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.594912 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.595167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.595304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.595443 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.595572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.595708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.595837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.595979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.596117 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.596261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.596429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.596572 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.596792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.596933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.597074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.597204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.597340 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.597521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.597654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.597791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.598002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.598143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.598272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.598514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.598665 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.598801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.598946 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.599083 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.599214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.599342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.599477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.599649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.599788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.599925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.600055 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.600184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.600322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.600461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.600669 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.600815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.600945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.602019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.602166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.602464 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.602672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.602814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.602944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.603106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.603252 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.603388 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.603517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.603646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.603773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.603919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.604096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.604254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.604254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.604533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.604694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.604839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.604979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.605108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.605244 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.605374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.605494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.605605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.606991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.607135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.607273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.607411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.607544 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.607736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.607875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.608014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.608152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.608152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.608397 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.608535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.608685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.608817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.608817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.609121 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.609252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.609390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.609520 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.609520 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.609774 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.609910 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.609910 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.610161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.610292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.610428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.610566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.610566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.610813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.610955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.611121 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.611250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.611250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.611250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.611743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.611897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.611897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.612420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.612582 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.612811 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.612959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.612959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.613245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.613375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.613511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.613631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.613631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.613886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.614015 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.614015 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.614257 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.614395 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.614532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.614662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.614662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.614906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.615035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.615035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.615325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.615453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.615582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.615710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.615845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.615994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.616125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.616253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.616253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.616513 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.616683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.616683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.617019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.617243 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.617243 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.617500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.617640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.617813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.617942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.617942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.618193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.618323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.618323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.618323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.618698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.618835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.618964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.619101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.619101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.619384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.619521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.619521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.619853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.619991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.619991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.620252 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.620381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.620517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.620708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.620708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.620966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.621106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.621277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.621416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.621630 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.621773 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.621773 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.622025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.622418 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.622418 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.622681 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.622835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.623033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.623166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.623334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.623473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.623473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.623727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.623858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.623858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.624102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.624237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.624382 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.624513 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.624513 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.624816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.624946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.625087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.625230 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.625230 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.625508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.625621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.625621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.625879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.626023 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.626023 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.626274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.626405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.626542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.626756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.626756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.627002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.627139 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.627275 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.627441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.627441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.627698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.627864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.627864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.628125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.628262 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.628407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.628687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.628687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.628966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.629096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.629096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.629096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.629507 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.629647 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.629647 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.629899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.630039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.630176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.630314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.630451 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.630581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.630725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.630868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.630868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.631113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.631239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.631351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.631476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.631476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.631797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.631924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.631924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.632142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.632268 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.632268 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.632864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.652915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.652915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.653406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.653568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.653568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.653865 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.653995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.654125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.654359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.654359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.654624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.654763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.655001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.655215 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.655376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.655515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.655515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.655771 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.655911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.655911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.656166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.656296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.656425 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.656554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.656554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.656889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.657031 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.657031 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.657284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.657415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.657551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.657691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.657856 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.658029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.658120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.658273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.658440 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.658601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.658754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.658900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.659063 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.659382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.659665 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.659833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.659988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.660134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.660278 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.660423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.660587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.660870 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.661022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.661167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.661312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.661465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.661620 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.661815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.661983 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.662207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.662366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.662512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.662673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.662979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.663146 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.663296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.664300 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.664614 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.664801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.665010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.665252 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.665411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.665557 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.665711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.665858 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.666021 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.666175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.666322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.666467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.666626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.666779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.666924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.667076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.667220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.667372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.667526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.667679 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.667824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.667978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.668374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.668527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.668720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.668879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.669032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.669177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.669493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.669676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.669946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.670107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.670253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.670406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.670406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.670704 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.670858 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.671011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.671164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.672632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.672860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.673263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.673430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.673833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.673993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.674148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.674317 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.674480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.674635 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.674782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.674928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.675080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.675260 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.675520 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.675672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.675869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.676016 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.676170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.676326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.676491 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.676671 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.676671 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.676968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.677118 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.677248 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.677362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.677474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.677595 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.677709 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.677871 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.678025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.678332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.678461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.678582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.678695 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.678893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.679011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.679123 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.679275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.679728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.679868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.680149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.680278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.680392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.680505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.680624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.680765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.683484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.683683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.684086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.684086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.684383 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.684544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.684742 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.684895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.685053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.685053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.685365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.685541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.685815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.685975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.685975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.686298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.686447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.686605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.686759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.686759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.687045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.687190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.687358 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.687505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.687658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.687805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.687805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.688080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.688235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.688235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.688733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.688887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.689044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.689191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.689191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.689191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.689698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.689978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.690146 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.690449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.690609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.690756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.690901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.691047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.691192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.691347 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.691502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.691664 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.691871 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.692029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.692195 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.692687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.692844 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.692991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.693149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.693296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.693699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.693900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.694327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.694498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.694645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.694799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.695065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.695308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.695479 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.695628 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.695798 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.696087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.696087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.696388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.696541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.696717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.696901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.697051 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.697216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.697402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.697558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.697704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.697859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.698120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.698300 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.698455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.698758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.698911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.699059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.699231 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.699391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.699538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.699684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.699832 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.701620 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.701841 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.701995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.702195 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 12:18:08.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.703881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.703881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.703881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.703881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.703881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.703881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.703881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.703881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.705328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.705328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.705328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.705328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.705328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.705328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.705328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.705328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.706580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.706580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.706580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.706580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.706580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.706580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.706580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.706580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.707706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.707706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.707706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.707706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.707706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.707706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.707706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.707706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.709038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.709038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.709038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.709038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.709038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.709038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.709038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.709038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.710403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.710403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 12:18:08.710403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 12:18:08.823198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO dbcounter [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Registered counter for database nova_api Aug 12 12:18:08.839162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO dbcounter [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Registered counter for database nova_api Aug 12 12:18:08.843689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:18:08.850194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writer thread running {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:18:08.858183 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_db.sqlalchemy.engines [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:18:08.864689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writer thread running {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:18:08.906529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.context [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2cc624e5-3553-4a43-9cb3-e1cc814c6191(cell1) {{(pid=121153) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 12:18:08.910522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:18:08.910996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:18:08.912544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:18:08.913321 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:18:08.913900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:18:08.915992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:18:08.918713 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO dbcounter [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Registered counter for database nova_cell0 Aug 12 12:18:08.922126 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.context [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2cc624e5-3553-4a43-9cb3-e1cc814c6191(cell1) {{(pid=121154) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 12:18:08.922344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO dbcounter [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Registered counter for database nova_cell1 Aug 12 12:18:08.926233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:18:08.926726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:18:08.928314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:18:08.929129 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:18:08.929666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:18:08.929786 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:18:08.931923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:18:08.932499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:18:08.933991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO dbcounter [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Registered counter for database nova_cell0 Aug 12 12:18:08.938188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO dbcounter [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Registered counter for database nova_cell1 Aug 12 12:18:08.938834 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writer thread running {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:18:08.941362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writer thread running {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:18:08.945951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_db.sqlalchemy.engines [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:18:08.948377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_db.sqlalchemy.engines [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:18:08.953065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writer thread running {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:18:09.086422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO dbcounter [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Registered counter for database nova_cell0 Aug 12 12:18:09.093039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:18:09.093686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writer thread running {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:18:09.097461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writer thread running {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:18:09.104578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO dbcounter [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Registered counter for database nova_cell0 Aug 12 12:18:09.111128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_db.sqlalchemy.engines [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 12:18:09.115555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writer thread running {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 12:18:09.419949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: WARNING keystonemiddleware.auth_token [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 12:18:09.427210 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: WARNING keystonemiddleware.auth_token [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 12:18:09.439190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: WARNING keystonemiddleware.auth_token [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 12:18:09.446792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: WARNING keystonemiddleware.auth_token [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 12:18:09.771633 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: WARNING keystonemiddleware.auth_token [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 12:18:09.778000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: WARNING keystonemiddleware.auth_token [None req-3c9c0ae9-47b2-413d-a003-6935fd185281 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 12:18:09.784177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d5075489c0 pid: 121153 (default app) Aug 12 12:18:09.793766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: WARNING keystonemiddleware.auth_token [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 12:18:09.800241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: WARNING keystonemiddleware.auth_token [None req-5e1055d2-0dbe-41ca-9a0c-5ea9919fdd0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 12:18:09.806778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d5075489c0 pid: 121154 (default app) Aug 12 12:18:45.049680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:18:45.050522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:18:45.052288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:18:45.052666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:18:45.158459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=3 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:18:45.158459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=3 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:18:45.158459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=3 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:18:45.158459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=3 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:18:46.033964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-890a8db0-43bf-4097-a46c-a27338c89f80 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Action: 'create', calling method: .version_select at 0x7f9914ebcdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-273901441", "metadata": {"Type": "work"}}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:18:46.186662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7e6220e0-a045-44fb-b4cc-9fa5ef43ff6d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Action: 'create', calling method: .version_select at 0x7f9914ebfdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564269972", "metadata": {"Type": "work"}}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7e6220e0-a045-44fb-b4cc-9fa5ef43ff6d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Request method failure captured: Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 121 Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kUlHw_pEl-9C-fBlTWC5qWqPFhkt2StiL0mZz70ETZVl-N99oYFrRD4kHqmYTGp0Bh3mn_Jm_-uH1CiPBuKoFtXJZrPi2cswsIt-xPeJk6ToHauYmrP21oHQkqoJtNZqgalNjRvZAjjXCs9w01EseLXuOCrJBe7ZC0ovOrHZjk9jOM Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:18:46.193556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ad47eec693748db9c3c0303fc8cc747", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}] Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0e30ba9436f940188d7fed18c8ca9dae Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564269972", "metadata": {"Type": "work"}}} Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: Aug 12 12:18:46.195115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-564269972', 'metadata': {'Type': 'work'}}}} Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise error Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi '#$%' Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:18:46.196036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 12:18:46.197741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 12:18:46.200240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 12:18:46.200240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.200240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7e6220e0-a045-44fb-b4cc-9fa5ef43ff6d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:18:46.200240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7e6220e0-a045-44fb-b4cc-9fa5ef43ff6d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.053748 Aug 12 12:18:46.200240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Aug 12 12:18:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1056 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 12:18:46.211734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-223eef43-baa1-4316-9874-0bddbbba2980 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Action: 'create', calling method: .version_select at 0x7f9914dca8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1264200610", "metadata": {"Type": "work"}}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-223eef43-baa1-4316-9874-0bddbbba2980 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Request method failure captured: Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 120 Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kUlHw_pEl-9C-fBlTWC5qWqPFhkt2StiL0mZz70ETZVl-N99oYFrRD4kHqmYTGp0Bh3mn_Jm_-uH1CiPBuKoFtXJZrPi2cswsIt-xPeJk6ToHauYmrP21oHQkqoJtNZqgalNjRvZAjjXCs9w01EseLXuOCrJBe7ZC0ovOrHZjk9jOM Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:18:46.215721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ad47eec693748db9c3c0303fc8cc747", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}] Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0e30ba9436f940188d7fed18c8ca9dae Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1264200610", "metadata": {"Type": "work"}}} Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: Aug 12 12:18:46.222980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1264200610', 'metadata': {'Type': 'work'}}}} Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise error Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi '0' Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:18:46.224065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 12:18:46.225570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 12:18:46.227005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 12:18:46.227005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.227005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-223eef43-baa1-4316-9874-0bddbbba2980 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:18:46.227005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-223eef43-baa1-4316-9874-0bddbbba2980 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010337 Aug 12 12:18:46.227005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Aug 12 12:18:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 12:18:46.233466 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d9e8209f-4739-4b0e-8edf-65b97c312981 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Action: 'create', calling method: .version_select at 0x7f9914d79940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-858328426", "metadata": {"Type": "work"}}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d9e8209f-4739-4b0e-8edf-65b97c312981 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Request method failure captured: Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 118 Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kUlHw_pEl-9C-fBlTWC5qWqPFhkt2StiL0mZz70ETZVl-N99oYFrRD4kHqmYTGp0Bh3mn_Jm_-uH1CiPBuKoFtXJZrPi2cswsIt-xPeJk6ToHauYmrP21oHQkqoJtNZqgalNjRvZAjjXCs9w01EseLXuOCrJBe7ZC0ovOrHZjk9jOM Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:18:46.236891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ad47eec693748db9c3c0303fc8cc747", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}] Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0e30ba9436f940188d7fed18c8ca9dae Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-858328426", "metadata": {"Type": "work"}}} Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: Aug 12 12:18:46.238940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-858328426', 'metadata': {'Type': 'work'}}}} Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise error Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi '' Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:18:46.240030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 12:18:46.243253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 12:18:46.245092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 12:18:46.245092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:46.245092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d9e8209f-4739-4b0e-8edf-65b97c312981 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:18:46.245092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d9e8209f-4739-4b0e-8edf-65b97c312981 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009708 Aug 12 12:18:46.245092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 3/3] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Aug 12 12:18:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 12:18:46.248823 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cf8c3837-0fd7-47c0-b404-166cd4c59b65 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Calling method '.version_select at 0x7f9914d79670>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:47.947077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-cf8c3837-0fd7-47c0-b404-166cd4c59b65 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] HTTP exception thrown: Volume tempest-invalid-1246930445 could not be found. Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cf8c3837-0fd7-47c0-b404-166cd4c59b65 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Request method failure captured: Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1246930445 HTTP/1.1 Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kUlHw_pEl-9C-fBlTWC5qWqPFhkt2StiL0mZz70ETZVl-N99oYFrRD4kHqmYTGp0Bh3mn_Jm_-uH1CiPBuKoFtXJZrPi2cswsIt-xPeJk6ToHauYmrP21oHQkqoJtNZqgalNjRvZAjjXCs9w01EseLXuOCrJBe7ZC0ovOrHZjk9jOM Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:18:47.955335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ad47eec693748db9c3c0303fc8cc747", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}] Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0e30ba9436f940188d7fed18c8ca9dae Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Volume tempest-invalid-1246930445 could not be found. Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'tempest-invalid-1246930445'} Aug 12 12:18:47.961060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1246930445 could not be found. (HTTP 404) (Request-ID: req-5dc4b1cb-53d4-48ba-b099-290c8c45ca54) Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:47.962702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 12:18:47.963801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1246930445 could not be found. Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:18:47.965075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1246930445 could not be found. Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1246930445 could not be found. Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cf8c3837-0fd7-47c0-b404-166cd4c59b65 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Returning 404 to user: Volume tempest-invalid-1246930445 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cf8c3837-0fd7-47c0-b404-166cd4c59b65 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1246930445" status: 404 len: 99 microversion: 2.1 time: 1.714308 Aug 12 12:18:47.967536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 4/4] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Aug 12 12:18:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1246930445 => generated 99 bytes in 1723 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 12 12:18:47.976929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c0dacfcf-6b90-4aa4-9350-88ddfa05f5b8 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006670 Aug 12 12:18:47.984377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 5/5] 10.222.0.27 () {58 vars in 1140 bytes} [Fri Aug 12 12:18:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 12 12:18:47.993236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b26899e7-a3a4-4104-b4b6-4dbf07293431 tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006129 Aug 12 12:18:47.999672 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 6/6] 10.222.0.27 () {58 vars in 1137 bytes} [Fri Aug 12 12:18:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 12 12:18:48.005686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-93eec164-0130-44ca-abae-f0c483bb902d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Calling method '.version_select at 0x7f9914cc7c10>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:48.093760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-890a8db0-43bf-4097-a46c-a27338c89f80 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.055799 Aug 12 12:18:48.094552 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 1/7] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Aug 12 12:18:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3059 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 12:18:48.120169 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dcc9af29-6f7c-4913-adc7-10aa027b2856 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Calling method '.version_select at 0x7f9914daac10>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:48.122995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-93eec164-0130-44ca-abae-f0c483bb902d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] HTTP exception thrown: Volume aa2a7bfb-8daf-417d-9e87-a2d008e5eecb could not be found. Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-93eec164-0130-44ca-abae-f0c483bb902d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Request method failure captured: Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/os-volumes/aa2a7bfb-8daf-417d-9e87-a2d008e5eecb HTTP/1.1 Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kUlHw_pEl-9C-fBlTWC5qWqPFhkt2StiL0mZz70ETZVl-N99oYFrRD4kHqmYTGp0Bh3mn_Jm_-uH1CiPBuKoFtXJZrPi2cswsIt-xPeJk6ToHauYmrP21oHQkqoJtNZqgalNjRvZAjjXCs9w01EseLXuOCrJBe7ZC0ovOrHZjk9jOM Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:18:48.125659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ad47eec693748db9c3c0303fc8cc747", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}] Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0e30ba9436f940188d7fed18c8ca9dae Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Volume aa2a7bfb-8daf-417d-9e87-a2d008e5eecb could not be found. Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'aa2a7bfb-8daf-417d-9e87-a2d008e5eecb'} Aug 12 12:18:48.126966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa2a7bfb-8daf-417d-9e87-a2d008e5eecb could not be found. (HTTP 404) (Request-ID: req-81c160c3-2e31-4a1c-9b93-f09ad9ece47c) Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:48.127730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 12:18:48.129416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa2a7bfb-8daf-417d-9e87-a2d008e5eecb could not be found. Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 12:18:48.130652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa2a7bfb-8daf-417d-9e87-a2d008e5eecb could not be found. Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa2a7bfb-8daf-417d-9e87-a2d008e5eecb could not be found. Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-93eec164-0130-44ca-abae-f0c483bb902d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Returning 404 to user: Volume aa2a7bfb-8daf-417d-9e87-a2d008e5eecb could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-93eec164-0130-44ca-abae-f0c483bb902d tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/aa2a7bfb-8daf-417d-9e87-a2d008e5eecb" status: 404 len: 109 microversion: 2.1 time: 0.126656 Aug 12 12:18:48.140780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 7/8] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:18:47 2022] DELETE /compute/v2.1/os-volumes/aa2a7bfb-8daf-417d-9e87-a2d008e5eecb => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:18:48.150753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-862ec4ab-34d3-47cc-8b44-b438aa14b54a tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Calling method '.version_select at 0x7f9914cc7700>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:48.193720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dcc9af29-6f7c-4913-adc7-10aa027b2856 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39" status: 200 len: 352 microversion: 2.1 time: 0.088296 Aug 12 12:18:48.194697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 2/9] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:48 2022] GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:18:48.224376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-862ec4ab-34d3-47cc-8b44-b438aa14b54a tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] HTTP exception thrown: Volume 2ff7669c-d312-497a-95e9-0b3db7184457 could not be found. Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-862ec4ab-34d3-47cc-8b44-b438aa14b54a tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Request method failure captured: Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/os-volumes/2ff7669c-d312-497a-95e9-0b3db7184457 HTTP/1.1 Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kUlHw_pEl-9C-fBlTWC5qWqPFhkt2StiL0mZz70ETZVl-N99oYFrRD4kHqmYTGp0Bh3mn_Jm_-uH1CiPBuKoFtXJZrPi2cswsIt-xPeJk6ToHauYmrP21oHQkqoJtNZqgalNjRvZAjjXCs9w01EseLXuOCrJBe7ZC0ovOrHZjk9jOM Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:18:48.227379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ad47eec693748db9c3c0303fc8cc747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ad47eec693748db9c3c0303fc8cc747", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ad47eec693748db9c3c0303fc8cc747"}]}] Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 9ad47eec693748db9c3c0303fc8cc747 Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesNegativeTest-1803632463 Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0e30ba9436f940188d7fed18c8ca9dae Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesNegativeTest-1803632463-project Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Volume 2ff7669c-d312-497a-95e9-0b3db7184457 could not be found. Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '2ff7669c-d312-497a-95e9-0b3db7184457'} Aug 12 12:18:48.241945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ff7669c-d312-497a-95e9-0b3db7184457 could not be found. (HTTP 404) (Request-ID: req-86f33624-007f-410b-956c-61e8a52bd4f4) Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:48.243989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:18:48.247041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ff7669c-d312-497a-95e9-0b3db7184457 could not be found. Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 12:18:48.249668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ff7669c-d312-497a-95e9-0b3db7184457 could not be found. Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ff7669c-d312-497a-95e9-0b3db7184457 could not be found. Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-862ec4ab-34d3-47cc-8b44-b438aa14b54a tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] Returning 404 to user: Volume 2ff7669c-d312-497a-95e9-0b3db7184457 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:18:48.252492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-862ec4ab-34d3-47cc-8b44-b438aa14b54a tempest-VolumesNegativeTest-1803632463 tempest-VolumesNegativeTest-1803632463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ff7669c-d312-497a-95e9-0b3db7184457" status: 404 len: 109 microversion: 2.1 time: 0.092873 Aug 12 12:18:48.255566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 8/10] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:48 2022] GET /compute/v2.1/os-volumes/2ff7669c-d312-497a-95e9-0b3db7184457 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:18:49.215539 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-85ade981-d131-411d-993c-886d66696a0a tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Calling method '.version_select at 0x7f9914d4e310>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:49.431625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-85ade981-d131-411d-993c-886d66696a0a tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39" status: 200 len: 352 microversion: 2.1 time: 0.226782 Aug 12 12:18:49.432472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 3/11] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:49 2022] GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 => generated 352 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:18:50.399164 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fea6f763-39c9-4e12-8a92-5b4a1f9ed47e tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f9914cc7550>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:50.450471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-22117b22-c62c-44e9-b39c-c6202d34b81c tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Calling method '.version_select at 0x7f9914d4e9d0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:50.522162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fea6f763-39c9-4e12-8a92-5b4a1f9ed47e tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8092b163-689a-4128-ad7d-767bf199c51c" status: 200 len: 350 microversion: 2.1 time: 0.128595 Aug 12 12:18:50.530540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 9/12] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:50 2022] GET /compute/v2.1/os-volumes/8092b163-689a-4128-ad7d-767bf199c51c => generated 350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:18:50.619095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-22117b22-c62c-44e9-b39c-c6202d34b81c tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39" status: 200 len: 353 microversion: 2.1 time: 0.176437 Aug 12 12:18:50.622719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 4/13] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:50 2022] GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:18:50.632180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9004aef1-ebd2-4113-a6a2-8767a932b398 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Calling method '.version_select at 0x7f9914da5790>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:51.617724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9004aef1-ebd2-4113-a6a2-8767a932b398 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39" status: 200 len: 353 microversion: 2.1 time: 0.989358 Aug 12 12:18:51.632993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 10/14] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:50 2022] GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 => generated 353 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:18:51.643128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1699cc70-1270-4e14-b577-9814525f1dc5 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Calling method '.version_select at 0x7f9914daadc0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:52.055789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1699cc70-1270-4e14-b577-9814525f1dc5 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39" status: 202 len: 0 microversion: 2.1 time: 0.416231 Aug 12 12:18:52.059615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 5/15] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:18:51 2022] DELETE /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:18:52.064621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-14b494e4-f6bd-4226-9fc0-4123d0d0ff18 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Calling method '.version_select at 0x7f9914d004c0>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:52.202339 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-14b494e4-f6bd-4226-9fc0-4123d0d0ff18 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39" status: 200 len: 352 microversion: 2.1 time: 0.141364 Aug 12 12:18:52.203328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 11/16] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:52 2022] GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:18:53.216213 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f7fd44d2-8f5f-45da-8f5f-a9941d0f1a50 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Calling method '.version_select at 0x7f9914d4ea60>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:53.309100 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f7fd44d2-8f5f-45da-8f5f-a9941d0f1a50 tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39" status: 200 len: 352 microversion: 2.1 time: 0.097425 Aug 12 12:18:53.316344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 6/17] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:53 2022] GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:18:54.221972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b19a5de4-32c6-4179-a649-dc971156efdb tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f9914d00b80>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:54.323104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7b1b02cb-e363-4e50-ae4c-67291481ee1b tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Calling method '.version_select at 0x7f9914d4e310>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:18:54.348898 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b19a5de4-32c6-4179-a649-dc971156efdb tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/150781b9-53ca-4554-9f45-947bb591007f" status: 200 len: 351 microversion: 2.1 time: 0.136901 Aug 12 12:18:54.349463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 12/18] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:54 2022] GET /compute/v2.1/os-volumes/150781b9-53ca-4554-9f45-947bb591007f => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:18:54.397889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-7b1b02cb-e363-4e50-ae4c-67291481ee1b tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] HTTP exception thrown: Volume c555226f-189d-45c0-af8e-4add9bf10c39 could not be found. Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7b1b02cb-e363-4e50-ae4c-67291481ee1b tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Request method failure captured: Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 HTTP/1.1 Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kUkhyxaGQ2vGkqTvSD2b13k-a1WXL472tIwq9pWnWxBb_3ShZsA6DCE86ueo9NvcKuCLRGBE70elVn08rLtONvERY3p4TkbCzB20CKnzvrs3H_AXuvUi7AlSickSHiiiYzwTK6S3Pmf71c9-HYkZoqQr1vZhSRMFDglAGWYHdFKRWI Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 29877b59841f428f9d094a309fdce828 Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesGetTestJSON-472305932 Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:18:54.402495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29877b59841f428f9d094a309fdce828"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/29877b59841f428f9d094a309fdce828"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_29877b59841f428f9d094a309fdce828", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29877b59841f428f9d094a309fdce828"}]}] Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesGetTestJSON-472305932 Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 29877b59841f428f9d094a309fdce828 Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesGetTestJSON-472305932 Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesGetTestJSON-472305932-project Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 253488caedb44ea4b3b7c1c8f5dc8731 Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesGetTestJSON-472305932-project Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Volume c555226f-189d-45c0-af8e-4add9bf10c39 could not be found. Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'c555226f-189d-45c0-af8e-4add9bf10c39'} Aug 12 12:18:54.403591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c555226f-189d-45c0-af8e-4add9bf10c39 could not be found. (HTTP 404) (Request-ID: req-f2c56ff5-103a-4b06-ac3f-65712171f217) Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:54.404187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:18:54.405065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c555226f-189d-45c0-af8e-4add9bf10c39 could not be found. Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 12:18:54.405894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c555226f-189d-45c0-af8e-4add9bf10c39 could not be found. Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c555226f-189d-45c0-af8e-4add9bf10c39 could not be found. Aug 12 12:18:54.406755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:18:54.410114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7b1b02cb-e363-4e50-ae4c-67291481ee1b tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] Returning 404 to user: Volume c555226f-189d-45c0-af8e-4add9bf10c39 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:18:54.414842 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7b1b02cb-e363-4e50-ae4c-67291481ee1b tempest-VolumesGetTestJSON-472305932 tempest-VolumesGetTestJSON-472305932-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39" status: 404 len: 109 microversion: 2.1 time: 0.093140 Aug 12 12:18:54.416784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 7/19] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:18:54 2022] GET /compute/v2.1/os-volumes/c555226f-189d-45c0-af8e-4add9bf10c39 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:18:59.824554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-147976232", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "networks": [{"uuid": "288d6ebd-6b5d-4fb7-8f52-366bee40b750"}]}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:00.074440 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] validate_networks() for [('288d6ebd-6b5d-4fb7-8f52-366bee40b750', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:19:01.794260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:19:01.794876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:19:01.795717 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:19:01.796271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:19:01.796762 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:19:01.859552 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:01.861156 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:01.864204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:01.865224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:01.866407 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:01.866991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:01.964558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Getting quotas for project a765c7ccb93545e0a90bc7ffc23a0d46. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:19:01.985946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Getting quotas for user 9bc7ffa8e3cf49fe9dcd8471c25be83a and project a765c7ccb93545e0a90bc7ffc23a0d46. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:19:02.041552 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:19:02.055360 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:19:02.313835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2915ed8e-a2a4-4772-8908-fa0427e7ceba tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.841739 Aug 12 12:19:02.314806 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 13/20] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:18:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:19:02.320426 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f2ff5747-6ac5-419e-98b0-43094d3ef7bd tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f99143ced30>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:02.370396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-503511248", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:02.408273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f2ff5747-6ac5-419e-98b0-43094d3ef7bd tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bb37d58f-e99e-4510-92ec-0c8d137d27d1" status: 200 len: 351 microversion: 2.1 time: 0.091441 Aug 12 12:19:02.409377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 14/21] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:19:02 2022] GET /compute/v2.1/os-volumes/bb37d58f-e99e-4510-92ec-0c8d137d27d1 => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:02.414292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-35f1e8ef-3991-4093-b58c-386150f8fead tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:02.415691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-35f1e8ef-3991-4093-b58c-386150f8fead tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:02.584528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] validate_networks() for [('2a6b8fb6-7157-42e0-853d-3067decf9a0e', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:19:02.707295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-35f1e8ef-3991-4093-b58c-386150f8fead tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:02.756855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-35f1e8ef-3991-4093-b58c-386150f8fead tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1214 microversion: 2.1 time: 0.345979 Aug 12 12:19:02.758228 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 15/22] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:02 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1214 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:02.777892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fab2da22-5cd8-472a-b86f-0d0934799e48 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f9914381dc0>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:03.168929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fab2da22-5cd8-472a-b86f-0d0934799e48 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.407367 Aug 12 12:19:03.170946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 16/23] 10.222.0.27 () {58 vars in 1134 bytes} [Fri Aug 12 12:19:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:03.194260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1828f6e7-9d65-437f-98ba-3c9c4130a0b1 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f9914381820>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:03.452586 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1828f6e7-9d65-437f-98ba-3c9c4130a0b1 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.265995 Aug 12 12:19:03.452586 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 17/24] 10.222.0.27 () {58 vars in 1149 bytes} [Fri Aug 12 12:19:03 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:19:03.482814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2cdca658-5812-494d-a5d2-20c4321c3b04 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f991438cd30>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:03.725024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2cdca658-5812-494d-a5d2-20c4321c3b04 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.261852 Aug 12 12:19:03.725826 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 18/25] 10.222.0.27 () {58 vars in 1134 bytes} [Fri Aug 12 12:19:03 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:03.740256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3c9ddcd1-8fa2-4191-ba0d-48863ca665e2 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f991438caf0>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:03.993940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3c9ddcd1-8fa2-4191-ba0d-48863ca665e2 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259006 Aug 12 12:19:03.994854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 19/26] 10.222.0.27 () {58 vars in 1167 bytes} [Fri Aug 12 12:19:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:04.002296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a755eb45-e79b-484b-8fc3-3439906d0464 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:04.002296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a755eb45-e79b-484b-8fc3-3439906d0464 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:04.251046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a755eb45-e79b-484b-8fc3-3439906d0464 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:04.263498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a755eb45-e79b-484b-8fc3-3439906d0464 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1214 microversion: 2.1 time: 0.267385 Aug 12 12:19:04.264608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 20/27] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:03 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:04.279717 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-04e1527b-33d0-4adf-894a-3b42746df6db tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f9914393160>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:04.363475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:19:04.364021 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:19:04.364598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:19:04.365999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:19:04.366519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:19:04.397438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:04.398512 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:04.399075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:04.402548 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:04.402548 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:04.404971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:04.459397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-04e1527b-33d0-4adf-894a-3b42746df6db tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.188791 Aug 12 12:19:04.468324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 21/28] 10.222.0.27 () {58 vars in 1170 bytes} [Fri Aug 12 12:19:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:04.476195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-de1374bd-0336-4621-a1f1-1b8ad81f7bba tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f99143e5f70>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:04.525702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Getting quotas for project 2e8def85acdd4e308bb51b4063c2ab4e. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:19:04.550001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Getting quotas for user 099b87a6c6b8409ab188c0b71ded7f55 and project 2e8def85acdd4e308bb51b4063c2ab4e. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:19:04.594542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:19:04.600536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:19:04.751300 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-de1374bd-0336-4621-a1f1-1b8ad81f7bba tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.281022 Aug 12 12:19:04.753017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 22/29] 10.222.0.27 () {58 vars in 1155 bytes} [Fri Aug 12 12:19:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:04.765969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-238f352f-4500-4e0d-bbcc-cf0c89de27c8 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f9914cc7af0>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:04.869576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-acb4a24e-4a7c-4e43-9914-7fd7ad34d8b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.885951 Aug 12 12:19:04.870773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 8/30] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:19:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:19:05.011950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-238f352f-4500-4e0d-bbcc-cf0c89de27c8 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.248605 Aug 12 12:19:05.014130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 23/31] 10.222.0.27 () {58 vars in 1188 bytes} [Fri Aug 12 12:19:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:19:05.026490 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b900b2a2-eff1-422d-9574-c3c4d76da303 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:05.027102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b900b2a2-eff1-422d-9574-c3c4d76da303 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:05.244133 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dc1f05ba-5eff-4749-8837-9b8c8005d503 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: .version_select at 0x7f99143b0700>, body: {"keypair": {"name": "tempest-keypair-807119452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDobFw131Osl7vsflPHzjlMw1uMQiWnH6pqn2QnlOZrL+tqY+7q8q986b7XzP9nkanNj0RD4Tp//auueC+iBy4fkg8HU4OG7hbUqW4XI480orxVCMpHDQKZgaQ8nvw/LIA=="}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:05.273443 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b900b2a2-eff1-422d-9574-c3c4d76da303 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:05.286110 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b900b2a2-eff1-422d-9574-c3c4d76da303 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1221 microversion: 2.1 time: 0.269744 Aug 12 12:19:05.297519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 24/32] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:05 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1221 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:05.322570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-41c82a49-e0ec-40b7-b0d1-c1f3dc19fb62 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] Calling method '.version_select at 0x7f991438c700>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:05.341224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-dc1f05ba-5eff-4749-8837-9b8c8005d503 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:19:05.359173 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-dc1f05ba-5eff-4749-8837-9b8c8005d503 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for user 0156c689e109489d9265dd3dd4d5cfde and project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:19:05.573960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dc1f05ba-5eff-4749-8837-9b8c8005d503 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.701775 Aug 12 12:19:05.574610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 9/33] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:19:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:05.580867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5df2fdc1-10e5-4099-ba4f-e997eaa85929 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:05.597920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5df2fdc1-10e5-4099-ba4f-e997eaa85929 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:05.745485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5df2fdc1-10e5-4099-ba4f-e997eaa85929 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:05.765746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-41c82a49-e0ec-40b7-b0d1-c1f3dc19fb62 tempest-VolumesTestJSON-2137404571 tempest-VolumesTestJSON-2137404571-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.452378 Aug 12 12:19:05.766483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 25/34] 10.222.0.27 () {58 vars in 1155 bytes} [Fri Aug 12 12:19:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:05.791379 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5df2fdc1-10e5-4099-ba4f-e997eaa85929 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1214 microversion: 2.1 time: 0.215293 Aug 12 12:19:05.801375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 10/35] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:05 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:05.812583 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1860409977", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:05.890837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-648761cc-1ec0-4d26-91c6-b545035cc297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'create', calling method: .version_select at 0x7f9914393040>, body: {"keypair": {"name": "tempest-keypair-1251810353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5iN3210ZryRJXSG/kquQuUWPY3CeuajuE63UAuMpEdjD6YPLAXxqlPyTI+ak7uNzwSnfeAxQLEzjCj5bcfwaLFDhVa8vyQDgMLj9dP7rEn71ZARyG+N6HAdwdL11lMRg=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:05.963391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] validate_networks() for [('2a6b8fb6-7157-42e0-853d-3067decf9a0e', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:19:05.994528 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-648761cc-1ec0-4d26-91c6-b545035cc297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Getting quotas for project f84d5684e1904e569a5551b9e21ce0ff. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:19:06.000537 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-648761cc-1ec0-4d26-91c6-b545035cc297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Getting quotas for user 383cbf83186747a5b81a12ed5288c39a and project f84d5684e1904e569a5551b9e21ce0ff. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:19:06.165037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-648761cc-1ec0-4d26-91c6-b545035cc297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.397153 Aug 12 12:19:06.167756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 26/36] 10.222.0.27 () {62 vars in 1200 bytes} [Fri Aug 12 12:19:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 400 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 12 12:19:06.827062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:06.827779 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:06.840257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:06.840947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:06.851870 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:06.854328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:06.858222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:06.859501 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:07.471776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:07.493250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-101a33a8-b708-4a64-b628-f53f0703a73e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1210 microversion: 2.1 time: 0.670463 Aug 12 12:19:07.513242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 27/37] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:06 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1210 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:07.587883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:19:07.589666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:19:07.590374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:19:07.591161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:19:07.591824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:19:07.604583 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:07.605402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:07.613576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:07.613576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:07.614224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:07.615059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:07.655624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Getting quotas for project 2e8def85acdd4e308bb51b4063c2ab4e. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:19:07.672765 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Getting quotas for user 099b87a6c6b8409ab188c0b71ded7f55 and project 2e8def85acdd4e308bb51b4063c2ab4e. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:19:07.686082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:19:07.688568 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:19:07.908028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-548ce41b-0182-4638-b578-9eac319b0a66 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.096520 Aug 12 12:19:07.922471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-18f0451c-ad92-40b5-b3d5-ab104dd8c26b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:07.925675 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-18f0451c-ad92-40b5-b3d5-ab104dd8c26b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:07.934701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 11/38] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:19:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:19:08.022893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-18f0451c-ad92-40b5-b3d5-ab104dd8c26b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:08.030921 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-18f0451c-ad92-40b5-b3d5-ab104dd8c26b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1222 microversion: 2.1 time: 0.112562 Aug 12 12:19:08.033849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 28/39] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:07 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:08.521907 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:08.522760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:08.536189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:08.536725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:08.537179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:08.537902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:08.538355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:08.538784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:08.860261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:08.873674 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-57ba8e51-cd35-48fe-8e73-7dd1d7452196 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1210 microversion: 2.1 time: 0.357704 Aug 12 12:19:08.874255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 12/40] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:08 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1210 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:09.070948 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-616d88c2-f9d0-4a33-8ebc-fc768c3aefdc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:09.083795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-616d88c2-f9d0-4a33-8ebc-fc768c3aefdc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:09.334624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-616d88c2-f9d0-4a33-8ebc-fc768c3aefdc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:09.346437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-616d88c2-f9d0-4a33-8ebc-fc768c3aefdc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1222 microversion: 2.1 time: 0.279759 Aug 12 12:19:09.348532 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 29/41] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:09 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1222 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:09.895256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:09.899511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:09.906475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:09.907168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:09.907744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:09.908989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:09.909768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:09.910695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:10.031173 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:10.042250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1df939d1-c5f4-4d3c-b0a9-3c3e76be26a1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1210 microversion: 2.1 time: 0.151800 Aug 12 12:19:10.053361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 13/42] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:09 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:10.174201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-827491971", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ab29f31-7915-471c-8e03-8b38ddd1a049"}], "security_groups": [{"name": "tempest-securitygroup--829522647"}], "key_name": "tempest-keypair-807119452", "user_data": "}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:10.367370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:10.368805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:10.376152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:10.376405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] validate_networks() for [('9ab29f31-7915-471c-8e03-8b38ddd1a049', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:19:10.378448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:10.379045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:10.379920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:10.380519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:10.381136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:10.572448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:10.581690 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1e2d2bc0-3907-44f0-bac4-beefe8e38905 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1226 microversion: 2.1 time: 0.219245 Aug 12 12:19:10.587644 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 14/43] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:10 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1226 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:10.741191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1484562654", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8429f5b2-c7e8-4466-9db8-df2db15d9f0c"}], "security_groups": [{"name": "tempest-securitygroup--1391195899"}], "key_name": "tempest-keypair-1251810353", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:11.081369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] validate_networks() for [('8429f5b2-c7e8-4466-9db8-df2db15d9f0c', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:19:11.890943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:19:11.893185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:19:11.893839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:19:11.894451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:19:11.895151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:19:11.899794 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:11.906947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:11.907679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:11.908856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:11.909971 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:11.910646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:11.911470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:11.987728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:19:11.998887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for user 0156c689e109489d9265dd3dd4d5cfde and project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:19:12.061246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:19:12.064045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:19:12.313177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-dbada610-4cd1-4e0c-890b-b0dcbee212ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.142517 Aug 12 12:19:12.324162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 30/44] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:19:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 2156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:19:12.335835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:12.338454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:12.353636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:12.354273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:12.354724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:12.355560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:12.356012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:12.357336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:12.364720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:19:12.365264 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:19:12.365782 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:19:12.366271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:19:12.366757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:19:12.391189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:12.391783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:12.392968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:12.393952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:12.394422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:12.395070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:12.492013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Getting quotas for project f84d5684e1904e569a5551b9e21ce0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:19:12.514747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Getting quotas for user 383cbf83186747a5b81a12ed5288c39a and project f84d5684e1904e569a5551b9e21ce0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:19:12.561991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:19:12.570615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:19:12.627321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:12.635070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-aaa3556e-fc15-4cc0-aa67-8ea088c5050b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1272 microversion: 2.1 time: 0.308645 Aug 12 12:19:12.635693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 31/45] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:12 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:12.649348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:12.661016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:12.675571 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:12.694957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:12.695424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:12.697387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:12.702464 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:12.727663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:12.842286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e319a5f3-486f-4966-bdaa-b62e60d779e9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.107017 Aug 12 12:19:12.852575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 15/46] 10.222.0.27 () {62 vars in 1188 bytes} [Fri Aug 12 12:19:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2119 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 12:19:12.865246 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1d00443a-610d-4fc1-8893-eb62acf6076b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:12.865872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1d00443a-610d-4fc1-8893-eb62acf6076b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:13.061196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:13.073864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-946219a5-4a13-4920-8173-a538fb72cc60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1292 microversion: 2.1 time: 0.437101 Aug 12 12:19:13.074958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 32/47] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:12 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1292 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:13.112277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6e04c87d-69ff-4592-82a8-86a040c20215 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:13.114404 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6e04c87d-69ff-4592-82a8-86a040c20215 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:13.145732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1d00443a-610d-4fc1-8893-eb62acf6076b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:13.157407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1d00443a-610d-4fc1-8893-eb62acf6076b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1240 microversion: 2.1 time: 0.301573 Aug 12 12:19:13.159824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 16/48] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:12 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1240 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:13.300217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e04c87d-69ff-4592-82a8-86a040c20215 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:13.313880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e04c87d-69ff-4592-82a8-86a040c20215 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:13.317320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e04c87d-69ff-4592-82a8-86a040c20215 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:13.319498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6e04c87d-69ff-4592-82a8-86a040c20215 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1282 microversion: 2.20 time: 0.241939 Aug 12 12:19:13.320360 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 33/49] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:13 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:13.659921 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:13.660537 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:13.667740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:13.675128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:13.675128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:13.675128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:13.675128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:13.675434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:13.749986 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:13.758688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bc47a468-ef88-4e9d-87a6-af8e9103d232 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1272 microversion: 2.1 time: 0.102855 Aug 12 12:19:13.759286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 17/50] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:13 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:14.095886 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:14.097346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:14.113992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:14.114899 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:14.115437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:14.116183 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:14.116673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:14.117085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:14.180616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-231e0f14-79d1-44b9-b1a6-e3e2d95b11b9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:14.182955 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-231e0f14-79d1-44b9-b1a6-e3e2d95b11b9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:14.370463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:14.382671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9f370ded-141a-42e5-8a5d-55aa6c7e9c59 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1280 microversion: 2.1 time: 0.291153 Aug 12 12:19:14.384322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 34/51] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:14 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:14.394611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0af6d760-1e4e-49bf-bb32-297ae410296c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:14.397561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0af6d760-1e4e-49bf-bb32-297ae410296c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:14.428474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-231e0f14-79d1-44b9-b1a6-e3e2d95b11b9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:14.443107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-231e0f14-79d1-44b9-b1a6-e3e2d95b11b9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1240 microversion: 2.1 time: 0.264352 Aug 12 12:19:14.443847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 18/52] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:14 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1240 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:14.582935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0af6d760-1e4e-49bf-bb32-297ae410296c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:14.582935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0af6d760-1e4e-49bf-bb32-297ae410296c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:14.583917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0af6d760-1e4e-49bf-bb32-297ae410296c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:14.585456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0af6d760-1e4e-49bf-bb32-297ae410296c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1282 microversion: 2.20 time: 0.199861 Aug 12 12:19:14.602874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 35/53] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:14 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1282 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:14.779777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:14.780706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:14.796154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:14.797040 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:14.797683 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:14.799297 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:14.799947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:14.800582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:15.410084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:15.411607 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:15.430853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:15.431597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:15.432204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:15.433187 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:15.433878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:15.434567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:16.183119 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:16.201186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-80c8661b-4de5-4211-ad11-a25d383ac428 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 1.421802 Aug 12 12:19:16.203317 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 19/54] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:14 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:16.230630 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:16.234586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:16.252421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:16.253220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:16.255979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:16.257001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:16.257686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:16.258776 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:16.318107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:16.326661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-21daabaa-d4de-48bc-aae9-740ec2c41e5a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.922177 Aug 12 12:19:16.342406 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 36/55] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:15 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:16.356696 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:16.357597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:16.369804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:16.370393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:16.375236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:16.376896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:16.378890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:16.379406 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:16.448311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:16.464191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-77c3e0d9-553b-473c-9255-8cea01946638 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1292 microversion: 2.1 time: 0.254164 Aug 12 12:19:16.467305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 20/56] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:16 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1292 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:16.542219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:16.557379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:16.570564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:16.571997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f3cbd81a-f0eb-43ee-80a8-026bb7d8d766 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1334 microversion: 2.20 time: 0.228450 Aug 12 12:19:16.596878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 37/57] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:16 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1334 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:17.232179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:17.233386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:17.255521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:17.261046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:17.262968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:17.272214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:17.276983 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:17.277712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:17.371063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:17.371754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:17.387815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:17.389130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:17.389907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:17.392925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:17.394115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:17.395081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:18.252414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:18.279284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-972e5e8e-0480-4ac0-8c82-e8b22d0dd3b5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 1.046268 Aug 12 12:19:18.280075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 21/58] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:17 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:18.293446 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:18.301560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:18.302411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:18.308926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:18.310851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0c6a7ed0-cd0a-4f5e-86a2-32639e22dbda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.943380 Aug 12 12:19:18.313219 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:18.314097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:18.317084 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:18.317784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:18.325359 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:18.325716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 38/59] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:17 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:18.369220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:18.369992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:18.378745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:18.379743 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:18.380363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:18.381375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:18.382878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:18.383965 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:18.607636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:18.633541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:18.637975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:18.641501 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-adfa62b0-333b-47f1-8980-43bbbd75b840 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1352 microversion: 2.20 time: 0.315569 Aug 12 12:19:18.644865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 39/60] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:18 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1352 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:18.675032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:18.697916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b4c7fde2-e476-4133-9891-0b179e77bf6b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1310 microversion: 2.1 time: 0.416466 Aug 12 12:19:18.700066 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 22/61] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:18 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1310 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:18.894200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-ff7f9115-52ab-434e-a962-6bfb16f57904 req-b5096fb9-6f4f-4a3f-b39c-36dc1e3f5f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d672f6c-0e6a-4766-b695-2e8cd409203a", "tag": "f95508bc-6fcf-40e6-bb4d-c949474b82d5"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:18.941593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ff7f9115-52ab-434e-a962-6bfb16f57904 req-b5096fb9-6f4f-4a3f-b39c-36dc1e3f5f5a service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:18.945408 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ff7f9115-52ab-434e-a962-6bfb16f57904 req-b5096fb9-6f4f-4a3f-b39c-36dc1e3f5f5a service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:18.946938 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ff7f9115-52ab-434e-a962-6bfb16f57904 req-b5096fb9-6f4f-4a3f-b39c-36dc1e3f5f5a service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.008910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-d5beb193-2391-4732-a931-a88094520d4b req-1bce2eb4-ac59-4df3-8073-83ce5b740f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3556b5-b492-4712-ae79-c1cfea75596f", "tag": "9616b601-7daa-4021-942a-ba6e7e79bf24"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:19.012258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-ff7f9115-52ab-434e-a962-6bfb16f57904 req-b5096fb9-6f4f-4a3f-b39c-36dc1e3f5f5a service nova] Creating event network-changed:f95508bc-6fcf-40e6-bb4d-c949474b82d5 for instance 1d672f6c-0e6a-4766-b695-2e8cd409203a on hv-cinder-79797 Aug 12 12:19:19.014278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ff7f9115-52ab-434e-a962-6bfb16f57904 req-b5096fb9-6f4f-4a3f-b39c-36dc1e3f5f5a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121154) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 12:19:19.015089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ff7f9115-52ab-434e-a962-6bfb16f57904 req-b5096fb9-6f4f-4a3f-b39c-36dc1e3f5f5a service nova] Acquired lock "compute-rpcapi-router" {{(pid=121154) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 12:19:19.018587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.029877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.030554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.031772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.033203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.033941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.040031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d5beb193-2391-4732-a931-a88094520d4b req-1bce2eb4-ac59-4df3-8073-83ce5b740f55 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.040870 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d5beb193-2391-4732-a931-a88094520d4b req-1bce2eb4-ac59-4df3-8073-83ce5b740f55 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.043748 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d5beb193-2391-4732-a931-a88094520d4b req-1bce2eb4-ac59-4df3-8073-83ce5b740f55 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.052847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.compute.rpcapi [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 12:19:19.054034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=121154) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 12:19:19.099159 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f299aa19-24d9-4274-8757-d8584b2731c6 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452161 Aug 12 12:19:19.100966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 40/62] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:19.117041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-d5beb193-2391-4732-a931-a88094520d4b req-1bce2eb4-ac59-4df3-8073-83ce5b740f55 service nova] Creating event network-changed:9616b601-7daa-4021-942a-ba6e7e79bf24 for instance 2e3556b5-b492-4712-ae79-c1cfea75596f on hv-cinder-79797 Aug 12 12:19:19.119191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d5beb193-2391-4732-a931-a88094520d4b req-1bce2eb4-ac59-4df3-8073-83ce5b740f55 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121153) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 12:19:19.121275 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d5beb193-2391-4732-a931-a88094520d4b req-1bce2eb4-ac59-4df3-8073-83ce5b740f55 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121153) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 12:19:19.125982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.128040 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.129517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.131379 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.134330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.135997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.162731 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.compute.rpcapi [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 12:19:19.168836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] Releasing lock "compute-rpcapi-router" {{(pid=121153) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 12:19:19.201703 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3ad6d7ee-5327-4f8f-8018-3b0d5adaa9ec None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.466662 Aug 12 12:19:19.205588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 23/63] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:19.305776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:19.307386 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:19.322720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.323642 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.325740 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.328045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.341723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:19.343328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:19.348330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.350160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.369163 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.373427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.374940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:19.379618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:19.380857 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:19.381868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:20.140393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:20.161672 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4d06a033-ad27-49c5-8f7e-83bc6157ec16 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.861177 Aug 12 12:19:20.162875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 41/64] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:19 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:20.168270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:20.169130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:20.192949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:20.195749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:20.197263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:20.198022 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:20.198487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:20.198963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:20.336235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:20.356218 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-84a4e292-7bd1-4e28-8124-cc5b6938ff9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 1.021494 Aug 12 12:19:20.364548 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 24/65] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:19 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:20.397942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:20.400177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:20.427970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:20.430469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:20.431088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:20.473711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:20.473711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:20.473711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:20.505917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:20.519153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:20.524626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:20.526375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f374b3a6-4520-47e2-a92e-96179024efa8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1340 microversion: 2.20 time: 0.362334 Aug 12 12:19:20.531242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 42/66] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:20 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1340 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:20.662657 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:20.676004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-43955497-3def-4a0d-9c15-dc5b18f7f54f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1298 microversion: 2.1 time: 0.290958 Aug 12 12:19:20.689450 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 25/67] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:20 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1298 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:21.150004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-c45bd42d-eced-4bf7-a334-088846d319eb req-508dfb86-c872-4fe1-8d5d-4668aef91146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310fc6f6-2f0e-4103-ab14-95e4175018d6", "tag": "50da9c0c-6eaf-494f-acc6-dc0530095799"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:21.173694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-c45bd42d-eced-4bf7-a334-088846d319eb req-508dfb86-c872-4fe1-8d5d-4668aef91146 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.174658 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-c45bd42d-eced-4bf7-a334-088846d319eb req-508dfb86-c872-4fe1-8d5d-4668aef91146 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:21.175205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-c45bd42d-eced-4bf7-a334-088846d319eb req-508dfb86-c872-4fe1-8d5d-4668aef91146 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:21.190747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:21.199923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-c45bd42d-eced-4bf7-a334-088846d319eb req-508dfb86-c872-4fe1-8d5d-4668aef91146 service nova] Creating event network-changed:50da9c0c-6eaf-494f-acc6-dc0530095799 for instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 on hv-cinder-79797 Aug 12 12:19:21.204710 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:21.208782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-c45bd42d-eced-4bf7-a334-088846d319eb req-508dfb86-c872-4fe1-8d5d-4668aef91146 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063930 Aug 12 12:19:21.210180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 43/68] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:21.228323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.229066 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:21.230242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:21.232355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.233064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:21.233701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:21.390274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:21.396218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:21.408074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:21.425342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.427916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:21.433510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:21.452576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.455030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:21.456931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:21.645385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:21.658472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-94de3abd-eac3-424b-b866-b3d48197d1b2 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.474814 Aug 12 12:19:21.661685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 26/69] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:21 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:21.680950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:21.682233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:21.687208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:21.692282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.693143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:21.693818 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:21.694824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.695522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:21.696203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:21.929702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:21.940156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:21.942296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:21.944067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c46aacf7-aca0-4bd7-9619-3b9042553581 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1340 microversion: 2.20 time: 0.281129 Aug 12 12:19:21.944991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 27/70] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:21 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1340 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:21.950063 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:21.950895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:21.982159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.982988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:21.985761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:21.991363 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:21.999233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:22.000013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:22.090819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:22.118280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d59d0f50-b50f-49d3-b21e-85259fd2f0fa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.734557 Aug 12 12:19:22.118280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 44/71] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:21 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:22.683922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:22.684551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:22.694302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:22.696270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:22.697403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:22.699195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:22.699867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:22.700574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:23.142152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:23.154562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a59e189c-634a-443c-9e7d-6fdcd060fc7c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 1.205899 Aug 12 12:19:23.155525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 28/72] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:21 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:23.161486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:23.174161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:23.183032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:23.183418 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:23.186996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:23.187783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:23.188868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:23.189304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:23.430519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:23.441290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9b79453f-5c75-43e2-9548-83fbf3b2ee9f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.761475 Aug 12 12:19:23.456705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 45/73] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:22 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:23.463373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:23.463979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:23.476559 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:23.478014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:23.478450 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:23.480728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:23.486538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:23.487191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:23.923720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:23.937617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:23.939860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:23.941032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fb9905b2-3186-473e-9409-2725d8b13a7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.783796 Aug 12 12:19:23.947197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 29/74] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:23 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:23.983080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-eda430dd-2e17-4dfa-8263-a9ae5b83fd0f req-51ec7ea3-bc83-43f5-843a-c2cd918e8eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0081c4-5cc9-45f7-b6bb-558b73793525", "tag": "05451aeb-84cb-4518-9499-706bfa3f9ff9"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:24.016285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-eda430dd-2e17-4dfa-8263-a9ae5b83fd0f req-51ec7ea3-bc83-43f5-843a-c2cd918e8eee service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:24.016285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-eda430dd-2e17-4dfa-8263-a9ae5b83fd0f req-51ec7ea3-bc83-43f5-843a-c2cd918e8eee service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:24.016285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-eda430dd-2e17-4dfa-8263-a9ae5b83fd0f req-51ec7ea3-bc83-43f5-843a-c2cd918e8eee service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:24.042596 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-eda430dd-2e17-4dfa-8263-a9ae5b83fd0f req-51ec7ea3-bc83-43f5-843a-c2cd918e8eee service nova] Creating event network-changed:05451aeb-84cb-4518-9499-706bfa3f9ff9 for instance eb0081c4-5cc9-45f7-b6bb-558b73793525 on hv-cinder-79797 Aug 12 12:19:24.051325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-eda430dd-2e17-4dfa-8263-a9ae5b83fd0f req-51ec7ea3-bc83-43f5-843a-c2cd918e8eee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081254 Aug 12 12:19:24.055988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 30/75] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:24.165410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:24.178310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:24.180126 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:24.188958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fdab9a40-54be-4144-b8ee-879c3ca466cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.730222 Aug 12 12:19:24.189538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 46/76] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:23 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:24.193356 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:24.194155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:24.194725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:24.195887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:24.200026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:24.202746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:24.254886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:24.435013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=28 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:24.467758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:24.471114 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:24.483693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:24.484622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:24.486842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:24.487671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:24.488217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:24.488664 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:24.519933 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:24.537085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9fe92cd4-b359-4c33-aab1-c3e965008808 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.362278 Aug 12 12:19:24.537911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 31/77] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:24 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:24.575853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=30 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:24.791348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:24.815869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-febfaf55-8331-4353-8d6a-1613fa70fdd4 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.356210 Aug 12 12:19:24.816463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 47/78] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:24 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:24.974153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:24.974787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:24.985486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:24.986004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:24.986856 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:24.987745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:24.988327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:24.988912 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:25.216196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:25.216994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:25.230999 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:25.234458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:25.237098 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:25.240576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:25.241392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:25.242308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:25.309331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:25.330588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:25.348995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:25.360592 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-290eb144-40bd-4462-a126-246f32436b07 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.382271 Aug 12 12:19:25.363351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 32/79] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:24 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:25.529378 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-6e6317e3-8c47-4481-b8f8-9d17f60ac70b req-c1c84468-5805-42e7-809c-0450d529dba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e50626-b455-4357-8ab1-4ed9dea35297", "tag": "ea96cc24-3c69-42d6-a3cc-6f2a132e8057"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:25.569405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6e6317e3-8c47-4481-b8f8-9d17f60ac70b req-c1c84468-5805-42e7-809c-0450d529dba4 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:25.576991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6e6317e3-8c47-4481-b8f8-9d17f60ac70b req-c1c84468-5805-42e7-809c-0450d529dba4 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:25.580690 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6e6317e3-8c47-4481-b8f8-9d17f60ac70b req-c1c84468-5805-42e7-809c-0450d529dba4 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:25.613477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-6e6317e3-8c47-4481-b8f8-9d17f60ac70b req-c1c84468-5805-42e7-809c-0450d529dba4 service nova] Creating event network-changed:ea96cc24-3c69-42d6-a3cc-6f2a132e8057 for instance 87e50626-b455-4357-8ab1-4ed9dea35297 on hv-cinder-79797 Aug 12 12:19:25.630074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-6e6317e3-8c47-4481-b8f8-9d17f60ac70b req-c1c84468-5805-42e7-809c-0450d529dba4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111111 Aug 12 12:19:25.632653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 33/80] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:25.642550 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:25.658333 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:25.680315 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:25.683072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:25.685609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:25.686686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:25.687601 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:25.688998 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:25.689890 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:25.694390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:25.705078 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-034672e3-47e6-48b7-a514-f962d9e975d4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.491904 Aug 12 12:19:25.705807 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 48/81] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:25 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:25.838379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:25.838997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:25.855799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:25.856300 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:25.861982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:25.865382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:25.868460 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:25.869178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:26.132886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:26.147897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4d1b2cc8-a094-4400-ae6a-e4b1ec8bf3f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.512186 Aug 12 12:19:26.165379 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 34/82] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:25 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:26.349085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:26.364510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d72d2747-2c39-4c48-99ea-5f0820dcf0eb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.529441 Aug 12 12:19:26.376673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 49/83] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:25 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:26.390719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:26.392156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:26.418656 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:26.419163 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:26.430898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:26.433490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:26.434229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:26.437420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:26.664221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:26.674708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:26.676242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:26.678826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c2d9d8f1-9e0a-4d37-bf8e-2508a91283c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.293955 Aug 12 12:19:26.693281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 35/84] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:26 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:26.727028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:26.728242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:26.736220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:26.736887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:26.737465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:26.738321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:26.738906 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:26.739467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:26.925833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:26.934113 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5db72131-24c9-4609-83e8-2ae506ad482c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.211353 Aug 12 12:19:26.935317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 50/85] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:26 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:27.173525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:27.174137 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:27.194498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:27.194498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:27.194498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:27.194498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:27.198418 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:27.198928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:27.381140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:27.390024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:27.390635 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:27.393854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3fccb5f8-82b8-4ee5-8183-6b7b34b4c502 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.223965 Aug 12 12:19:27.394820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 36/86] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:27 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:27.397677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:27.398346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:27.398935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:27.399976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:27.406321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:27.423641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:27.612366 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:27.623882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6d8d00fc-c0af-4706-80f4-59869b714980 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.237319 Aug 12 12:19:27.636844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 51/87] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:27 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:27.702361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:27.705956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:27.709677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:27.710156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:27.710584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:27.711262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:27.711709 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:27.712119 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:27.852028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:27.867545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:27.869160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:27.870402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-42731b64-4ebd-431a-9719-1332a6a348c3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.172238 Aug 12 12:19:27.884829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 37/88] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:27 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:27.963342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:27.963943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:27.969855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:27.970343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:27.971104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:27.972058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:27.973902 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:27.974347 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:28.101731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:28.110124 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d6823930-2c78-40b8-a514-dd80936e9e85 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.150155 Aug 12 12:19:28.111040 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 52/89] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:27 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:28.415229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:28.415854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:28.422945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:28.423484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:28.423971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:28.424673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:28.425257 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:28.425695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:28.557480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:28.565983 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ae3ac439-850d-43c4-9fc1-07a88e964422 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.154707 Aug 12 12:19:28.566558 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 38/90] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:28 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:28.647619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:28.648163 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:28.654361 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:28.659253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:28.659253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:28.659253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:28.659253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:28.659580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:28.787768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:28.795323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8b4a11bd-0022-4055-ac9c-5bd061d4905e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.151678 Aug 12 12:19:28.797573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 53/91] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:28 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:28.893899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:28.894936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:28.901779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:28.902264 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:28.902695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:28.903396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:28.903834 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:28.904254 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:29.038698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:29.048056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:29.049644 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:29.050756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b0b5288e-884c-494f-b17e-06b654bec60a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.160989 Aug 12 12:19:29.051490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 39/92] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:28 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:29.131063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:29.131669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:29.133564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=4 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:29.138248 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:29.138737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:29.139171 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:29.140216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:29.140303 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:29.140854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:29.271401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:29.279196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-be116556-7faf-42ec-9405-9be9fa65e2db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.151911 Aug 12 12:19:29.279769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 54/93] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:29 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:29.587911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:29.588580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:29.590723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=8 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:29.595518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:29.596009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:29.596440 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:29.597162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:29.597612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:29.598040 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:29.806898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:29.816164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fdf1dac9-e374-4709-baf1-0a2e1b0dccba tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.232475 Aug 12 12:19:29.816567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:29.817297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:29.817628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 40/94] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:29 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:29.825033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:29.825756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:29.826337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:29.827163 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:29.827771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:29.828394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:30.072331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:30.072972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:30.079380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:30.080262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:30.080934 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:30.081784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:30.082373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:30.082935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:30.196570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:30.209000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-70e04d43-08e4-4ac5-b917-871f2445745d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.396117 Aug 12 12:19:30.209530 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 55/95] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:29 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:30.265640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:30.274198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:30.275707 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:30.276826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-40650552-8aba-4481-9105-dbdf013d3399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.208421 Aug 12 12:19:30.277424 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 41/96] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:30 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:30.299802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:30.303474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:30.306263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:30.306739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:30.307166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:30.307837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:30.308280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:30.308749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:30.491352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:30.513242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e305206d-aeca-49fc-905d-7e0a039b4ed7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.204002 Aug 12 12:19:30.513242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 56/97] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:30 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:30.837715 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:30.838499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:30.849364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:30.849873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:30.850295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:30.850986 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:30.851655 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:30.852233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:31.034661 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:31.043108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2e70b050-b02f-4517-8e8c-85c493eaa5fd tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.209470 Aug 12 12:19:31.043824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 42/98] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:30 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:31.229015 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:31.229629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:31.235817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:31.236528 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:31.237218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:31.237928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:31.238388 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:31.238918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:31.299796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:31.300581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:31.308012 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:31.309147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:31.309147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:31.309698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:31.310092 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:31.311022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:31.473383 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:31.481526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-16074b81-2148-44a4-9c3c-95c74e77197e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.256438 Aug 12 12:19:31.492619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 57/99] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:31 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:31.513599 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:31.522705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:31.524225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:31.525392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-738cc44c-6f96-444d-9f94-aa468a244b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.229836 Aug 12 12:19:31.526343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 43/100] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:31 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:31.529211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:31.530064 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:31.536334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:31.537028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:31.537470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:31.538167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:31.538612 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:31.539255 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:31.674077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:31.681587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f711ed66-baab-4948-8040-e99d48efc13d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.159716 Aug 12 12:19:31.682147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 58/101] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:31 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:32.071290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:32.072503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:32.083350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:32.083945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:32.084476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:32.085276 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:32.085788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:32.090992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:32.295234 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:32.303701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7a5ee1ec-bba2-4ad0-b8f1-faab53f194c5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.236210 Aug 12 12:19:32.304259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 44/102] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:32 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:32.514919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:32.514919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:32.514919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:32.514919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:32.515759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:32.515759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:32.515759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:32.515759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:32.549243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:32.550261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:32.556624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:32.557147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:32.557659 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:32.558453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:32.558966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:32.559454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:32.719882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:32.727998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-61dd978b-ce63-47f7-8f9d-8fa1d1524d82 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.228612 Aug 12 12:19:32.728679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 59/103] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:32 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:32.733088 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:32.733690 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:32.794765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:32.794765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:32.794765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:32.794765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:32.795223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:32.795223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:32.795438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:32.795438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:32.795585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:32.795585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f3df47a8-0308-4699-86f0-1e71b8f044d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.218332 Aug 12 12:19:32.795585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 45/104] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:32 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:32.891290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:32.901716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d19391d3-a7b2-4469-80cd-1bf484004ca4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.172044 Aug 12 12:19:32.902301 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 60/105] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:32 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:33.324062 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:33.324728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:33.331231 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:33.331708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:33.332139 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:33.332847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:33.333293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:33.333711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:33.477184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:33.484767 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-58456b0a-be4f-41f9-afd5-2b14ac9bcb5f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.164499 Aug 12 12:19:33.485427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 46/106] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:33 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:33.821752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:33.823223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:33.826239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:33.827245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:33.833744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:33.835080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:33.840778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:33.840902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:33.841014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:33.841014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:33.841190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:33.841190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:33.841358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:33.841439 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:33.841519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:33.841519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:34.037432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:34.048549 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:34.052807 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c51ef0d8-a27c-49ba-90c3-4f4dbe97ef90 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.237636 Aug 12 12:19:34.053569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 61/107] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:33 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:34.057151 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:34.058726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:34.058846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:34.059597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:34.060366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-288fa322-b420-4ab7-aa33-e74d886c0e0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.238657 Aug 12 12:19:34.061349 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 47/108] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:33 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:34.066046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:34.066693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:34.067411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:34.068006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:34.068458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:34.069060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:34.210147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:34.217839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3b910f47-eb94-4f95-9c1c-36c4ccab05d2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.163109 Aug 12 12:19:34.218495 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 62/109] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:34 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:34.506764 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:34.508339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:34.518103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:34.519174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:34.519661 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:34.520846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:34.522035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:34.522671 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:34.666330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:34.672102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:34.674585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4d507e32-6c8b-416d-aa40-509b63bc8f56 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.171975 Aug 12 12:19:34.675144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 48/110] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:34 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:35.073682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:35.074287 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:35.082997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:35.083602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:35.093416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:35.094890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:35.096144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:35.097037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:35.097464 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:35.098043 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:35.098882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:35.100301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:35.100755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:35.101345 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:35.101750 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:35.105257 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:35.347877 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:35.357467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:35.359336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:35.360133 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fbe73db1-599e-4c59-80a8-23d7e064e527 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.281255 Aug 12 12:19:35.361806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 49/111] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:35 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:35.366455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:35.367065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:35.373068 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:35.373786 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:35.374390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:35.375260 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:35.375902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:35.376395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:35.382068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:35.390571 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b5eacaff-dc39-404d-aac5-3f0242eb9a53 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.320793 Aug 12 12:19:35.391394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 63/112] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:35 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:35.528993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:35.544554 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3767dba1-3974-45ea-b26f-d971c527759e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.181129 Aug 12 12:19:35.546741 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 50/113] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:35 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:35.695783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:35.696396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:35.702461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:35.702950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:35.703375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:35.704053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:35.705216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:35.708594 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:35.858033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:35.867176 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-30e5877b-7e5c-4605-af5f-fadbd31f9072 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.175531 Aug 12 12:19:35.868693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 64/114] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:35 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:36.388431 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:36.389115 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:36.400391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:36.404099 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:36.404575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:36.406261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:36.406261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:36.412312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:36.412974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:36.423435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:36.423900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:36.424345 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:36.425093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:36.425567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:36.425999 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:36.428849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:36.479042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:36.643492 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:36.652102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:36.653690 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:36.654582 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:36.654791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9a53e768-35b3-4887-842f-f810433d1ce2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.275388 Aug 12 12:19:36.655344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 51/115] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:36 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:36.660249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:36.661144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:36.670792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:36.670792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:36.670792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:36.671314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:36.671760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:36.672175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:36.680673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e7a58311-400a-452d-b089-febf4c4b638f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.273223 Aug 12 12:19:36.698726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 65/116] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:36 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:36.816967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:36.825351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-108d5ce2-b135-465f-ac6f-b97ac9f4922e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.169037 Aug 12 12:19:36.826003 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 52/117] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:36 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:36.888597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:36.889238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:36.895414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:36.895891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:36.896325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:36.897092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:36.897533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:36.897951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:37.025365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:37.033175 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b94468cd-7347-43ee-8c13-026dd87533c6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.148537 Aug 12 12:19:37.033856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 66/118] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:36 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:37.678394 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:37.679001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:37.685501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:37.685987 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:37.686422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:37.687109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:37.687559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:37.687981 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:37.701973 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:37.702589 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:37.709083 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:37.709588 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:37.710014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:37.710694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:37.711134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:37.711547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:37.893428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:37.897704 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:37.901751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:37.906414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-732d22fd-991b-4db5-a22c-1117abab5385 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.208077 Aug 12 12:19:37.906535 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:37.907197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 67/119] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:37 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:37.910517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-140a8a72-4c53-4017-8691-aef116a67e31 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.233257 Aug 12 12:19:37.910517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 53/120] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:37 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:37.913707 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:37.914789 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:37.922024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:37.922721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:37.923334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:37.924152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:37.924756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:37.925344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:38.055366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:38.055987 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:38.059850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:38.062064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:38.062745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:38.063182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:38.064500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:38.064985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:38.065434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:38.069975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-567c3de0-e210-4cba-ae3a-bfef380aa19d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.161112 Aug 12 12:19:38.070548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 68/121] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:37 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:38.194676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:38.202353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9df406c8-5e48-43e2-86ff-e9413ae6eb67 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.151645 Aug 12 12:19:38.203160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 54/122] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:38 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:38.929567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:38.930897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:38.937262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:38.937947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:38.938053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:38.938697 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:38.939352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:38.940250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:38.940809 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:38.941242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:38.947384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:38.947869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:38.948299 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:38.949015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:38.949460 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:38.949874 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:39.141137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:39.152901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d597fc8d-27f1-4fa4-a401-833d3b8099d7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.227477 Aug 12 12:19:39.154083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:39.154223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 69/123] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:38 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:39.159373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:39.159964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:39.164705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:39.166145 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:39.173371 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:39.173785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:39.173785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:39.173969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13127b0e-ca7b-4a63-884b-1d6f41bf093f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.234379 Aug 12 12:19:39.174052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:39.174052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:39.174202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 55/124] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:38 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:39.174280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:39.223672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:39.224205 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:39.230436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:39.230923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:39.231357 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:39.232043 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:39.232500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:39.232986 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:39.346134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:39.353608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a480ed83-c8db-4010-bb08-e11c727b1593 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.198568 Aug 12 12:19:39.354165 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 70/125] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:39 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:39.388878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:39.396335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e8de95c3-9b0b-42d5-a51a-5e8c2d029455 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.176916 Aug 12 12:19:39.396916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 56/126] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:39 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:40.174980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:40.175580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:40.181995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:40.182508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:40.182941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:40.183612 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:40.184059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:40.184524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:40.191327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:40.191928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:40.197826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:40.198298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:40.198723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:40.199389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:40.199842 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:40.200337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:40.373806 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:40.382138 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cdbb4d97-05db-40c3-9d46-aa09bd3be02f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.211151 Aug 12 12:19:40.382865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 71/127] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:40 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:40.385337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:40.387570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:40.388381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:40.395354 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:40.395586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:40.395972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:40.396412 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:40.397136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:40.397238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:40.397595 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:40.398020 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:40.398229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9a80722a-73e2-4916-b0a1-3aba6f0e4cca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.210936 Aug 12 12:19:40.412681 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 57/128] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:40 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:40.416667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:40.417279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:40.423670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:40.424150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:40.424583 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:40.425344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:40.425739 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:40.426159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:40.574185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:40.582409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e4031df7-0dc6-4947-8407-9ddd48f80a8d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.198509 Aug 12 12:19:40.583048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 72/129] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:40 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:40.600814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:40.608119 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-20b88fd5-b33c-420b-882b-cfb9f113ed92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.195395 Aug 12 12:19:40.608683 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 58/130] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:40 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:41.403028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:41.403640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:41.410458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:41.410940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:41.411369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:41.412046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:41.412487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:41.412984 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:41.420325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:41.421076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:41.427223 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:41.427796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:41.428232 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:41.428941 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:41.429390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:41.429810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:41.612967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:41.616185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:41.621120 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5dbce97a-5cc5-40c4-b20a-521646662d40 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.221747 Aug 12 12:19:41.621774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 73/131] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:41 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:41.624178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:41.625846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:41.628172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:41.629023 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:41.632755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-39c84e5a-fd5f-4fc0-b342-c75a7dd5d216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.211161 Aug 12 12:19:41.632755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 59/132] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:41 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:41.635103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:41.635754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:41.636400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:41.637298 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:41.637936 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:41.638421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:41.640658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:41.641299 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:41.650136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:41.650671 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:41.651109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:41.651792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:41.652238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:41.652675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:41.843283 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:41.847502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:41.851548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1e803b1e-7317-493c-95d2-e7c03ca23572 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.228806 Aug 12 12:19:41.852146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 74/133] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:41 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:41.855253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d00ba46d-f1b4-4459-8e66-379ab4ee1146 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.220400 Aug 12 12:19:41.856075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 60/134] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:41 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:42.643273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:42.644004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:42.649688 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:42.650172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:42.650633 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:42.651309 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:42.651754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:42.652170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:42.657053 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:42.657621 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:42.663536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:42.670134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:42.670134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:42.670134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:42.670134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:42.670538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:42.860092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:42.864384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:42.868190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cde84653-38bc-49db-89ae-5dc7fa39dd3b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.229511 Aug 12 12:19:42.868787 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 75/135] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:42 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:42.873238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:42.873835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:42.879410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:42.880312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:42.880830 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:42.881261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:42.881400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:42.882071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:42.882441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:42.882569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b7528d2c-938e-4a52-9586-f6d046bd8a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.229375 Aug 12 12:19:42.882874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:42.883311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 61/136] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:42 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:42.888026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:42.889997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:42.899889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:42.899889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:42.900178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:42.900908 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:42.901394 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:42.901836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:43.089360 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:43.095551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:43.097825 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e2face11-1db3-4fb2-805b-50fc0da2bffe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.228011 Aug 12 12:19:43.100834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 76/137] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:42 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:43.104775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4760474f-d008-4adb-b709-e9ee96b059cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.220655 Aug 12 12:19:43.105344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 62/138] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:42 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:43.889679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:43.890385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:43.896886 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:43.897365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:43.897800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:43.898475 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:43.898923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:43.899344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:43.905683 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:43.906396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:43.913081 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:43.913636 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:43.914449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:43.915060 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:43.915511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:43.919155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:44.115276 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:44.124774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-02acdf65-f7c7-4327-bde1-7c463aada982 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.238881 Aug 12 12:19:44.125355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 77/139] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:43 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:44.130100 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:44.133584 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:44.134649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:44.138743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:44.140511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:44.142458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b4535c46-e595-44bd-b12e-1df4bf21a127 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.240156 Aug 12 12:19:44.143464 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:44.143685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 63/140] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:43 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:44.144353 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:44.144842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:44.145691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:44.146140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:44.146562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:44.148246 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:44.148891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:44.154997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:44.155485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:44.155924 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:44.156612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:44.157096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:44.157620 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:44.379442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:44.387465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cf26ca7e-19a4-442d-96b8-f7769a0207e0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.242706 Aug 12 12:19:44.388320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 64/141] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:44 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:44.400981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:44.402985 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-63b92cae-598f-43b1-81c6-4794272736d1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.275703 Aug 12 12:19:44.403570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 78/142] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:44 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:44.838004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-546cae8e-4253-4efb-a2d3-1adee3e9b0a3 req-a97e705c-cf57-4b0c-9b47-058797bfaf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d672f6c-0e6a-4766-b695-2e8cd409203a", "name": "network-vif-plugged", "status": "completed", "tag": "f95508bc-6fcf-40e6-bb4d-c949474b82d5"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:44.848154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-546cae8e-4253-4efb-a2d3-1adee3e9b0a3 req-a97e705c-cf57-4b0c-9b47-058797bfaf67 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:44.848651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-546cae8e-4253-4efb-a2d3-1adee3e9b0a3 req-a97e705c-cf57-4b0c-9b47-058797bfaf67 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:44.849085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-546cae8e-4253-4efb-a2d3-1adee3e9b0a3 req-a97e705c-cf57-4b0c-9b47-058797bfaf67 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:44.859684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-546cae8e-4253-4efb-a2d3-1adee3e9b0a3 req-a97e705c-cf57-4b0c-9b47-058797bfaf67 service nova] Creating event network-vif-plugged:f95508bc-6fcf-40e6-bb4d-c949474b82d5 for instance 1d672f6c-0e6a-4766-b695-2e8cd409203a on hv-cinder-79797 Aug 12 12:19:44.864954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-546cae8e-4253-4efb-a2d3-1adee3e9b0a3 req-a97e705c-cf57-4b0c-9b47-058797bfaf67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115235 Aug 12 12:19:44.865546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 65/143] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:45.146540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:45.147270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:45.153242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:45.153759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:45.154105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:45.154758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:45.155204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:45.155617 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:45.165659 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:45.166341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:45.172582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:45.173793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:45.174442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:45.180791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:45.180791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:45.180791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:45.180791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:45.531986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:45.535868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:45.539952 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fa6b1742-26e0-4e7b-8f9a-ced0016ebd91 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.397139 Aug 12 12:19:45.540531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 79/144] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:45 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:45.545059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:45.545892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:45.546494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:45.546598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:45.547677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dfee936e-25d7-4c0f-a4bf-4663593cd3c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.386532 Aug 12 12:19:45.548230 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 66/145] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:45 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:45.552871 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:45.553297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:45.553724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:45.554403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:45.554849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:45.555267 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:45.560183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:45.560942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:45.567520 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:45.567999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:45.568429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:45.569140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:45.569589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:45.570011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:45.748616 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:45.753257 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:45.759653 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a2536061-79c4-4666-bce9-e613afc50f66 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.218070 Aug 12 12:19:45.760363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 80/146] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:45 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:45.762328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6d04d1c4-6697-4b57-bcfd-ebe70be9aabb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.212873 Aug 12 12:19:45.768855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 67/147] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:45 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:46.561116 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:46.561677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:46.568507 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:46.569020 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:46.569449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:46.570306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:46.570750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:46.570984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:46.571439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:46.571587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:46.578149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:46.578699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:46.579823 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:46.580697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:46.581586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:46.582210 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:46.780828 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:46.791687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-192c4aea-906e-4c69-8292-e4110977121f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.234612 Aug 12 12:19:46.794495 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 81/148] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:46 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:46.796214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:46.805289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:46.811463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:46.811463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:46.811663 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:46.811663 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-22c9ec5b-c78b-4c24-ba08-ad24b1484ad6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.244720 Aug 12 12:19:46.816785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 68/149] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:46 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:46.826198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:46.826810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:46.827348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:46.827840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:46.828271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:46.831363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:46.831988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:46.833268 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:46.835168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:46.835723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:46.836442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:46.837405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:46.837882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:46.838365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:46.839314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:47.046881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:47.051624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:47.056009 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d014d892-2e18-4c35-9361-c4a876b77cef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.260345 Aug 12 12:19:47.056577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 82/150] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:46 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:47.059354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d8605ef2-2092-442d-8fcd-70ee135bfced tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.243872 Aug 12 12:19:47.059986 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 69/151] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:46 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:47.816052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:47.816890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:47.822741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:47.823218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:47.824270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:47.824697 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:47.825132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:47.825556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:47.835027 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:47.835615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:47.841772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:47.842268 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:47.842701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:47.843404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:47.843852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:47.844341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:48.082176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:48.084925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:48.092722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:48.094342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-eb551d6b-27a3-4178-a66f-58d13bc94b0c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.284867 Aug 12 12:19:48.094491 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:48.098108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dfe0843f-652e-4d36-bf8e-ac4a9b624d6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.264578 Aug 12 12:19:48.098108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 70/152] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:47 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:48.098648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 83/153] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:47 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:48.113040 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:48.114777 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:48.116380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:48.117024 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:48.123827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:48.124317 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:48.124782 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:48.126233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:48.127025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:48.127744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:48.129337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:48.129832 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:48.130271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:48.130997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:48.131448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:48.131928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:48.329397 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:48.332950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:48.336810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-110a87f8-f99b-4d5a-9a18-3f28cab92413 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.239000 Aug 12 12:19:48.337385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 71/154] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:48 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:48.341739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f58000bf-f682-4113-83a9-964ecf654bad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.241943 Aug 12 12:19:48.342377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 84/155] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:48 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:49.117042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:49.117654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:49.124487 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:49.125526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:49.126503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:49.127193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:49.127646 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:49.133884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:49.134317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:49.134317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:49.140478 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:49.141590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:49.142325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:49.143313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:49.143878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:49.144442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:49.338412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:49.342435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:49.346708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b3560aad-d998-41f9-811f-eae67ddef6ce tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.233459 Aug 12 12:19:49.347460 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 72/156] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:49 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:49.351365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:49.353082 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:49.354802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-be1dd892-210c-4e45-96fb-bda4fc423775 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.231333 Aug 12 12:19:49.374899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:49.374899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:49.376086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 85/157] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:49 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:49.383939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:49.384471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:49.384931 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:49.385817 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:49.386320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:49.386752 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:49.388455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:49.390005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:49.397384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:49.399346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:49.399825 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:49.400473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:49.400998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:49.401446 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:49.666750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:49.674956 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0e8f13b3-c554-442a-bcb5-7264ab59abb0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.297549 Aug 12 12:19:49.675516 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 86/158] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:49 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:49.688623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:49.689712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f7cdf1cb-1f81-4729-8eba-48ec8ac6889c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.329774 Aug 12 12:19:49.690287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 73/159] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:49 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:50.371850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:50.373381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:50.380944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:50.381464 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:50.381807 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:50.381902 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:50.382358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:50.383326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:50.383779 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:50.384465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:50.389115 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:50.389965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:50.390054 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:50.390683 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:50.392106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:50.392784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:50.603907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:50.609011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:50.612130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b4ce83ce-0f48-428a-a03d-6daa6815573e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.245872 Aug 12 12:19:50.612725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 87/160] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:50 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:50.618038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:50.619883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:50.621272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ca641799-dd1c-43e9-bbbe-7b960d15528d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.245971 Aug 12 12:19:50.622110 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 74/161] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:50 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:50.695359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:50.695972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:50.704174 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:50.706509 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:50.706509 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:50.706509 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:50.706784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:50.707053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:50.711609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:50.712362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:50.730020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:50.732156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:50.737511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:50.737511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:50.737511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:50.737511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:50.943485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:50.951384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f54799db-0d9d-43c4-87b4-5ebdb5fd2cfd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.260088 Aug 12 12:19:50.952606 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 88/162] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:50 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:50.979793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:50.989371 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7dc60165-cf0a-4ef1-a4c0-20405f7a0e23 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.281887 Aug 12 12:19:51.012988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 75/163] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:50 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:51.632825 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:51.633442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:51.639922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:51.640504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:51.641640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:51.642778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:51.643239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:51.643684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:51.644531 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:51.645696 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:51.652035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:51.652725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:51.653305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:51.657744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:51.657744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:51.657744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:51.857646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:51.866318 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bf06c0ed-de32-49e2-9161-f309d4195ef6 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.237378 Aug 12 12:19:51.867696 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 89/164] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:51 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:51.871535 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:51.882499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:51.884208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:51.885386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-14f33d3b-bfe9-4dce-8225-31d91c479df0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.245790 Aug 12 12:19:51.892774 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 76/165] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:51 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:19:51.973362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:51.973976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:51.980070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:51.980557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:51.981123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:51.981813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:51.982276 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:51.982686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:52.021757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:52.022532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:52.028962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:52.034535 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:52.042410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:52.042948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:52.043680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:52.044144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:52.044568 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:52.179693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:52.189166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9c9fadf2-e9a1-47d4-87a5-5d3b49e0c009 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.220387 Aug 12 12:19:52.189737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 90/166] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:51 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:52.212495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:52.220943 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c46e5b15-a50f-41e6-a615-2abd4938ee40 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.205215 Aug 12 12:19:52.221760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 77/167] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:52 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:52.887137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:52.887739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:52.889608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=93 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:52.895006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:52.895502 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:52.895935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:52.896801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:52.897166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:52.897590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:52.913317 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:52.914244 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:52.921304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:52.921868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:52.922869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:52.923799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:52.924428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:52.924869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:53.106822 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:53.111053 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:53.115049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b01923b3-8983-4cd0-bf73-50effdd24913 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.231642 Aug 12 12:19:53.115827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 91/168] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:52 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:53.120097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:53.121682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:53.123138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-56802f42-e458-465a-8fd8-b58de54fccb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.214056 Aug 12 12:19:53.123367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 78/169] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:52 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:53.209518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:53.210226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:53.216203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:53.216704 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:53.217154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:53.217801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:53.218255 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:53.218671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:53.241704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:53.242448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:53.248372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:53.249013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:53.249469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:53.250219 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:53.250745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:53.251518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:53.398329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:53.405751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7f1afa9f-d14f-4914-9056-bbe4f9dc9dbe tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.199999 Aug 12 12:19:53.406331 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 92/170] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:53 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:53.425472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:53.433084 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-64914eaa-eced-4bef-83c4-53775ca2d398 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.195168 Aug 12 12:19:53.433651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 79/171] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:53 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:54.136250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:54.136912 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:54.143667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:54.144174 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:54.144796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:54.145475 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:54.145920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:54.146338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:54.146957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:54.147761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:54.154177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:54.154725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:54.155174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:54.155849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:54.156299 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:54.157298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:54.344815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:54.348753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:54.352351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1f08854a-2cb0-432b-81c0-10eea87a5520 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.219943 Aug 12 12:19:54.353029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 93/172] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:54 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:54.357748 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:54.359825 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:54.361265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b4c13b36-edcc-42b6-b68b-b59745d8a785 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.218892 Aug 12 12:19:54.361880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 80/173] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:54 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:54.428014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:54.428611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:54.434538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:54.435013 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:54.435536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:54.436111 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:54.436559 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:54.437000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:54.453161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:54.454635 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:54.461597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:54.462152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:54.462680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:54.463560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:54.464088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:54.464546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:54.643173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:54.647284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:54.650817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-061e0f4b-1f21-4dbe-9ad3-ad0e8a37a366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.226587 Aug 12 12:19:54.651381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 94/174] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:54 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:54.655037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-39136297-92a0-432a-ad61-e538341a29a1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.205642 Aug 12 12:19:54.655771 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 81/175] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:54 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:55.326287 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-b1e62556-062b-40e0-bb8d-563bd2a86238 req-194964bc-8955-4d2d-833c-9cf034e8efee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3556b5-b492-4712-ae79-c1cfea75596f", "name": "network-vif-plugged", "status": "completed", "tag": "9616b601-7daa-4021-942a-ba6e7e79bf24"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:19:55.340566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b1e62556-062b-40e0-bb8d-563bd2a86238 req-194964bc-8955-4d2d-833c-9cf034e8efee service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.341482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b1e62556-062b-40e0-bb8d-563bd2a86238 req-194964bc-8955-4d2d-833c-9cf034e8efee service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.341969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b1e62556-062b-40e0-bb8d-563bd2a86238 req-194964bc-8955-4d2d-833c-9cf034e8efee service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.354089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-b1e62556-062b-40e0-bb8d-563bd2a86238 req-194964bc-8955-4d2d-833c-9cf034e8efee service nova] Creating event network-vif-plugged:9616b601-7daa-4021-942a-ba6e7e79bf24 for instance 2e3556b5-b492-4712-ae79-c1cfea75596f on hv-cinder-79797 Aug 12 12:19:55.359647 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-b1e62556-062b-40e0-bb8d-563bd2a86238 req-194964bc-8955-4d2d-833c-9cf034e8efee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036862 Aug 12 12:19:55.360251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 95/176] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:19:55.374074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:55.374673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:55.381886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.382370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.382796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.383469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.383917 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.384330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.384616 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:55.385331 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:55.392409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.392939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.393379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.394067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.394517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.394965 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.590769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:55.594433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:55.598826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f0244a6f-73b0-4dfa-bde0-08aa42b07b08 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.228494 Aug 12 12:19:55.599536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 82/177] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:55 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:55.612064 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:55.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:55.621900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:55.622995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2736d09d-2ae5-44c1-a47f-6f77a80ddeb4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.242562 Aug 12 12:19:55.623535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 96/178] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:55 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:55.672975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:55.673625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:55.677004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:55.677776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:55.682816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.683314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.683756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.684472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.684860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.684980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.685358 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.685525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.686027 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.686827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:55.687442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:55.688492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:55.891488 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:55.898918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-527c13eb-1b75-4752-88e6-ea90cf1c2d7b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.230338 Aug 12 12:19:55.899467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 83/179] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:55 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:55.899681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:55.907929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fa502418-2fa6-44c0-8974-5d5b040eec03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.236564 Aug 12 12:19:55.908492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 97/180] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:55 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:56.620531 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:56.621754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:56.628571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:56.629199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:56.629686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:56.630467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:56.630969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:56.631444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:56.647022 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:56.647623 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:56.653543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:56.654016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:56.654439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:56.655213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:56.655662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:56.656728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:56.836470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:56.841211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:56.844139 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5eaca8c6-f0d3-474a-838d-c1b327fa9b4f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.227965 Aug 12 12:19:56.845194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 84/181] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:56 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:56.850232 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:56.851936 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:56.853171 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b4f75968-cf73-4271-9884-138bcffef441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.210252 Aug 12 12:19:56.864666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 98/182] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:56 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:56.921042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:56.922642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:56.928658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:56.929150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:56.929584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:56.930274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:56.930629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:56.930749 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:56.931283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:56.931852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:56.952818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:56.954106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:56.954772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:56.955657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:56.956303 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:56.956897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:56.986284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:19:57.168423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:57.179571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3960e008-7200-4908-8fe5-3fbad84ab925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.263402 Aug 12 12:19:57.194407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 85/183] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:56 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:57.209547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:57.216821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f92ba206-d9ab-491b-b6e0-0426c6c0c2cb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.291314 Aug 12 12:19:57.217660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 99/184] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:56 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:57.865557 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:57.866154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:57.872267 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:57.872867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:57.873300 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:57.873980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:57.874425 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:57.875606 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:57.875930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:57.877077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:57.883203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:57.883670 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:57.884382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:57.885103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:57.885754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:57.886174 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:58.260566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:58.261627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:58.269281 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:58.269510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9b8a4279-c8f8-42d2-9eec-2b0834f5233f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.407969 Aug 12 12:19:58.270086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 86/185] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:57 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:58.270888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:58.271996 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1e82439f-0898-436d-9219-07136a19ec16 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.400670 Aug 12 12:19:58.272677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 100/186] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:57 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:58.275791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:58.276530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:58.277012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:58.277611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:58.283993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:58.284726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:58.285297 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:58.285403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:58.285880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:58.286317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:58.286507 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:58.287055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:58.287466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:58.287568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:58.288059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:58.288766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:58.492916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:58.495371 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:58.507858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bd9a88be-3855-41bb-9c6f-544360173339 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.234126 Aug 12 12:19:58.508000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0599f9fb-9b7b-4f6e-96d2-b9b940462532 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.234231 Aug 12 12:19:58.508539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 101/187] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:58 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:58.513199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 87/188] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:58 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:59.291488 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:59.292093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:59.298758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:59.298970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:59.299426 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:59.299667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:59.300356 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:59.300520 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:59.300837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:59.308284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:59.308513 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:59.308513 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:59.308513 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:59.308859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:59.309310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:59.309938 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:59.507571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:59.517437 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:59.518962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:59.519115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:59.520076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-88ac1821-4221-49c1-b574-46a2cdce4e93 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.225896 Aug 12 12:19:59.520686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 88/189] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:19:59 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:19:59.527946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5a8690b1-94c5-4f57-9094-825a0ec35d86 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.240442 Aug 12 12:19:59.528633 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 102/190] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:59 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:19:59.528897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:59.529492 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:59.537487 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:59.538272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:59.539120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:59.540217 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:59.541071 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:59.541636 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:59.543301 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:19:59.544054 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:19:59.550367 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:59.551136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:59.551573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:59.552290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:19:59.552762 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:19:59.553188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:19:59.746160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:59.747485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:19:59.754727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5b4b4d7c-df31-44b2-84f1-494a0f4b8480 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.229867 Aug 12 12:19:59.755311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 89/191] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:59 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:19:59.755814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c0824320-0c53-449b-91f6-42685257b654 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.225187 Aug 12 12:19:59.756375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 103/192] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:19:59 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:00.549391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:00.549999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:00.550319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:00.550922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:00.556243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:00.556756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:00.556917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:00.557188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:00.557396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:00.557858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:00.558001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:00.558298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:00.558579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:00.558711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:00.559026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:00.559468 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:00.748411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:00.751410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:00.756582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:00.758138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:00.758777 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c4948072-4fcd-4e4b-886f-ac688cefce73 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.212846 Aug 12 12:20:00.759249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6e2b291b-3e7d-4398-8fcd-7db793ce3cb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.214577 Aug 12 12:20:00.759346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 104/193] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:00 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:00.759888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 90/194] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:00 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:00.775809 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:00.776434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:00.776742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:00.777352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:00.782890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:00.783365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:00.783666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:00.783780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:00.784152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:00.784448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:00.784589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:00.784927 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:00.785296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:00.785400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:00.785747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:00.786174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:00.980970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:00.988677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:00.989074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-27158532-0212-4a3b-9dd6-fb3ef7f91a92 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.217584 Aug 12 12:20:00.989641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 105/195] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:00 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:00.995973 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d00fa599-a81e-45b9-8062-442f012d53e7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.222840 Aug 12 12:20:00.996511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 91/196] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:00 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:01.779605 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:01.780203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:01.781548 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:01.782158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:01.786278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:01.786754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:01.787182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:01.787855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:01.787965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:01.788543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:01.788672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:01.788985 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:01.789094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:01.789666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:01.790105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:01.790520 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:01.986920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:01.990172 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:01.994389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a0a65728-e056-4331-a01e-8de13d4c1c0d tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.218811 Aug 12 12:20:01.995000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 106/197] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:01 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:01.998029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:01.999547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:02.000628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1797c5e4-7e7a-455a-836b-80b9a4837122 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.223157 Aug 12 12:20:02.001190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 92/198] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:01 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:02.010831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:02.011472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:02.017719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:02.018329 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:02.018527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:02.019016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:02.019455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:02.020147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:02.020601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:02.021062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:02.024213 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:02.024721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:02.025175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:02.025839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:02.026293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:02.026714 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:02.211662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:02.215673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:02.219652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1d1876da-91ef-4b48-b100-d665e7276bad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.213154 Aug 12 12:20:02.220225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 107/199] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:02 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:02.223575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fa7bfedc-be60-4e02-8f18-2fd155486cac tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.209707 Aug 12 12:20:02.224129 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 93/200] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:02 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:03.013903 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:03.014525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:03.021320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:03.021797 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:03.022219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:03.022824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:03.023306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:03.023306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:03.023483 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:03.023715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:03.029383 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:03.029864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:03.030295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:03.031131 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:03.031584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:03.032725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:03.230125 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:03.234162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:03.239756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9a1374b3-1dc2-42f1-8263-418975cf105f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.229637 Aug 12 12:20:03.240338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 108/201] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:03 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:03.242945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:03.244491 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:03.244788 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:03.245410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:03.245729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-620480a4-5ebf-4be4-852d-9fc5db0c2a86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.226969 Aug 12 12:20:03.246287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 94/202] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:03 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:03.258972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:03.259097 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:03.259180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:03.259251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:03.259251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:03.259251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:03.259251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:03.259508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:03.259575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:03.259741 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:03.261028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:03.261729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:03.262189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:03.262616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:03.444869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:03.453734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e3cc3b48-e8cb-43b0-a119-03eab62dc504 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.212347 Aug 12 12:20:03.454517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 109/203] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:03 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:03.457728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:03.470867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fa3b477d-fe1f-4af4-85b6-859230a8663b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.223460 Aug 12 12:20:03.471388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 95/204] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:03 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:04.263288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:04.263885 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:04.267486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:04.268082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:04.270164 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:04.270643 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:04.271075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:04.271755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:04.272204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:04.272630 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:04.274068 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:04.274545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:04.274973 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:04.275664 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:04.276097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:04.276517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:04.474357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:04.483145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:04.487101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3183b63a-5b2a-4517-a603-d25e0911690f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.227664 Aug 12 12:20:04.487852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 110/205] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:04 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:04.502405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:04.502528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:04.503083 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:04.504370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:04.505645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c7732109-dfec-401e-8526-45fd5f11b01f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.242291 Aug 12 12:20:04.507562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 96/206] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:04 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:04.512680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:04.513172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:04.513660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:04.514300 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:04.514792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:04.515212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:04.519935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:04.520873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:04.527409 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:04.527895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:04.528328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:04.529122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:04.529576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:04.529999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:04.741752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:04.742755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:04.750118 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-67967b54-98ff-4242-9161-b3ae7942db7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.242556 Aug 12 12:20:04.750889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 97/207] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:04 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:04.760485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e7f8490c-9ad3-443d-bc3b-64f53ff44495 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.260789 Aug 12 12:20:04.761421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 111/208] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:04 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:05.148802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-0c8de6f1-09a5-467e-9b4f-5c5ef5c42e1f req-c4fd8ff6-8a83-48fc-8a0a-2496070f133e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310fc6f6-2f0e-4103-ab14-95e4175018d6", "name": "network-vif-plugged", "status": "completed", "tag": "50da9c0c-6eaf-494f-acc6-dc0530095799"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:20:05.158163 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0c8de6f1-09a5-467e-9b4f-5c5ef5c42e1f req-c4fd8ff6-8a83-48fc-8a0a-2496070f133e service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.158633 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0c8de6f1-09a5-467e-9b4f-5c5ef5c42e1f req-c4fd8ff6-8a83-48fc-8a0a-2496070f133e service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.159063 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0c8de6f1-09a5-467e-9b4f-5c5ef5c42e1f req-c4fd8ff6-8a83-48fc-8a0a-2496070f133e service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.170559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-0c8de6f1-09a5-467e-9b4f-5c5ef5c42e1f req-c4fd8ff6-8a83-48fc-8a0a-2496070f133e service nova] Creating event network-vif-plugged:50da9c0c-6eaf-494f-acc6-dc0530095799 for instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 on hv-cinder-79797 Aug 12 12:20:05.177291 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-0c8de6f1-09a5-467e-9b4f-5c5ef5c42e1f req-c4fd8ff6-8a83-48fc-8a0a-2496070f133e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Aug 12 12:20:05.180761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 98/209] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:20:05.509283 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:05.509923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:05.516770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.517810 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.518239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.518925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.519369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.519784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.530639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:05.531178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:05.537262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.543000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.543000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.543000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.543000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.543462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.752683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:05.763376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-970be06c-4efe-4272-9339-0d083b408dbf tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.258283 Aug 12 12:20:05.764139 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 112/210] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:05 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:05.775752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:05.779239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:05.790761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.791313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.791746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.792435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.792939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.793358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.808958 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:05.821304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:05.823374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:05.824887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a995ddfd-cb68-4fe9-993c-787f13b625f6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.298745 Aug 12 12:20:05.825928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 99/211] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:05 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:05.831628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:05.832502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:05.840094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.840904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.841541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.842464 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:05.843801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:05.844593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:05.849829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:05.999456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:06.012381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-06546ee3-c674-4add-9d12-b2895eebccc3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.240411 Aug 12 12:20:06.013377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 113/212] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:05 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:06.022041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:06.032420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b0e9c7c3-afc2-4aac-82fb-4ab7df336e22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.205020 Aug 12 12:20:06.033108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 100/213] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:05 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:06.784978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:06.785574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:06.791767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:06.792241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:06.792687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:06.793362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:06.793805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:06.794220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:06.859602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:06.860878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:06.866887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:06.867374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:06.867805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:06.868493 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:06.868969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:06.869412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:06.962465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:06.970459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4c2069b4-153f-4734-a2de-c1579a3defc7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.189237 Aug 12 12:20:06.971028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 114/214] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:06 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:07.021681 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:07.031591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:07.033176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:07.034589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c50316b2-7b37-4d74-b2b0-3a1b415f6b82 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.179793 Aug 12 12:20:07.035153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 101/215] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:06 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:07.035274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:07.035796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:07.042070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:07.042565 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:07.042975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:07.043692 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:07.044140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:07.044560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:07.052558 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:07.053192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:07.059972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:07.060463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:07.060935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:07.062052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:07.062781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:07.063406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:07.234202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:07.241621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5974ff49-1bc5-4412-aa66-4e19d3920301 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.211967 Aug 12 12:20:07.242192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 115/216] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:07 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:07.259288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:07.266613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5b8463cc-a5ce-4549-b648-8e9b9eb7cd20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.217782 Aug 12 12:20:07.267164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 102/217] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:07 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:07.991288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:07.991910 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:07.998244 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:07.998654 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:07.999614 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:08.000387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:08.000874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:08.001295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:08.005467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:08.057532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:08.058125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:08.064999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:08.065481 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:08.065910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:08.066584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:08.067026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:08.067446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:08.162967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:08.170682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1b08af92-d06c-4790-985a-37cc9dc0ca12 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.183244 Aug 12 12:20:08.171338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 116/218] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:07 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:08.218992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:08.226930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:08.228423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:08.229547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-77293083-a48a-47bd-b794-c9232f51edd5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.176059 Aug 12 12:20:08.230102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 103/219] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:08 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:08.262370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:08.262914 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:08.269487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:08.269964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:08.270393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:08.271068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:08.271518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:08.271937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:08.286657 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:08.287265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:08.293389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:08.293871 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:08.294310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:08.294988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:08.295439 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:08.295864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:08.468611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:08.476902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:08.478669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-edb42275-b5f5-4791-bf56-75e8a65947f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.218880 Aug 12 12:20:08.478669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 117/220] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:08 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:08.486679 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-28883b20-64d1-433d-930d-8a6c1fec99eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.203626 Aug 12 12:20:08.487239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 104/221] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:08 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:09.191538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:09.192140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:09.198125 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:09.198600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:09.199035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:09.199708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:09.200157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:09.200577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:09.251752 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:09.252364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:09.258335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:09.258819 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:09.259255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:09.259943 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:09.260396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:09.260851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:09.374073 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:09.384150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fe115773-5bef-4137-84c3-238b462de33b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.196404 Aug 12 12:20:09.384739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 118/222] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:09 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:09.423093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:09.431582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:09.433182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:09.434327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-577ce555-07f2-402f-9778-8ae76f31d31b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.186770 Aug 12 12:20:09.434886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 105/223] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:09 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:09.498006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:09.499109 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:09.505167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:09.505644 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:09.506076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:09.506750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:09.507225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:09.509098 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:09.509214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:09.509368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:09.519501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:09.519991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:09.520434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:09.521159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:09.521641 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:09.522068 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:09.705837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:09.709014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:09.714393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bbb668b5-3146-4813-a13c-ca6a314e5a31 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.220253 Aug 12 12:20:09.714982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 119/224] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:09 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:09.716356 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-185808fa-665f-4a21-b79b-e547a126c819 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.211445 Aug 12 12:20:09.716941 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 106/225] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:09 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:10.406150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:10.406792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:10.412730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:10.413471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:10.413906 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:10.414587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:10.415041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:10.415469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:10.457188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:10.463720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:10.463720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:10.464148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:10.464574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:10.465274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:10.465719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:10.466134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:10.602334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:10.610323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-815ac6ce-b97f-44ea-85a8-2d27cfb3c960 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.208123 Aug 12 12:20:10.610882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 120/226] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:10 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:10.627303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:10.635150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:10.636696 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:10.637791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6ec9664f-81ea-4a19-b00d-232090be27ad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.184504 Aug 12 12:20:10.638341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 107/227] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:10 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:10.736037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:10.736550 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:10.737013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:10.737628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:10.742678 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:10.743154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:10.743563 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:10.743676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:10.744050 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:10.744241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:10.744481 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:10.744709 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:10.745131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:10.745222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:10.745627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:10.746117 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:10.943226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:10.952334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5a23e958-b15f-4662-990c-443de0e55cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.220580 Aug 12 12:20:10.953379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 121/228] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:10 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:10.955798 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:10.963380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-138ddbbf-c118-4eaa-8f24-51c5f9df5b11 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.231138 Aug 12 12:20:10.964179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 108/229] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:10 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:11.630629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:11.631266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:11.637103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:11.637579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:11.638010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:11.638681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:11.639683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:11.640197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:11.660494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:11.661243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:11.667318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:11.667797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:11.668227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:11.668918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:11.669364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:11.669776 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:11.988263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:11.997534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-019f3330-a250-47dc-b608-ef28efbf9f04 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.369167 Aug 12 12:20:11.997534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 122/230] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:11 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:12.001706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:12.005306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:12.005819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:12.012011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:12.012617 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:12.013103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:12.013796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:12.014925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:12.015346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:12.017203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:12.018862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:12.020128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-205b056c-4b29-4f72-a725-1ce035afe103 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.363400 Aug 12 12:20:12.033271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 109/231] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:11 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:12.043786 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:12.044404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:12.050283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:12.050769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:12.051200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:12.051894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:12.052339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:12.052789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:12.222895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:12.230004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:12.230736 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6a775493-6531-49a8-ab97-d8f6f06f2515 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.229481 Aug 12 12:20:12.231489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 123/232] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:11 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:12.238724 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fc1eccad-cefa-44b8-9be8-4d9ccec10d84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.204198 Aug 12 12:20:12.239284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 110/233] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:12 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:13.021614 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:13.022796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:13.028804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.029293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.030341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.031162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.031618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.032044 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.049167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:13.052521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:13.058292 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.058790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.059214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.059899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.060345 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.062124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.304814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:13.313831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-061ed4ec-18c7-42a7-81c2-ec68635cc13b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.296167 Aug 12 12:20:13.314407 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 124/234] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:13 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:13.316247 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:13.320004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:13.320143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:13.325341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:13.327198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.328166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.328602 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.329271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:13.329433 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.329847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.330265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.330866 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-62881229-fa11-432c-a901-3984193651a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.285381 Aug 12 12:20:13.331572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 111/235] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:13 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:13.336291 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:13.336948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:13.345397 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.345962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.346458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.347206 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.347849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.348466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.542973 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:13.545899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:13.550734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3709bad4-4a49-40af-8d90-245cc0f0d583 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.235192 Aug 12 12:20:13.564766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 125/236] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:13 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:13.564950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-38788f79-80fb-400c-be4d-812e93e94fcb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.220683 Aug 12 12:20:13.564950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 112/237] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:13 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:13.565091 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-c1dab6f4-4bde-46d0-b755-411f0c283a90 req-d928b7de-c5c1-49a1-a228-40c80ad20bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0081c4-5cc9-45f7-b6bb-558b73793525", "name": "network-vif-plugged", "status": "completed", "tag": "05451aeb-84cb-4518-9499-706bfa3f9ff9"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:20:13.566248 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-c1dab6f4-4bde-46d0-b755-411f0c283a90 req-d928b7de-c5c1-49a1-a228-40c80ad20bc1 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:13.566722 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-c1dab6f4-4bde-46d0-b755-411f0c283a90 req-d928b7de-c5c1-49a1-a228-40c80ad20bc1 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:13.567153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-c1dab6f4-4bde-46d0-b755-411f0c283a90 req-d928b7de-c5c1-49a1-a228-40c80ad20bc1 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:13.579048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-c1dab6f4-4bde-46d0-b755-411f0c283a90 req-d928b7de-c5c1-49a1-a228-40c80ad20bc1 service nova] Creating event network-vif-plugged:05451aeb-84cb-4518-9499-706bfa3f9ff9 for instance eb0081c4-5cc9-45f7-b6bb-558b73793525 on hv-cinder-79797 Aug 12 12:20:13.583933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-c1dab6f4-4bde-46d0-b755-411f0c283a90 req-d928b7de-c5c1-49a1-a228-40c80ad20bc1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031313 Aug 12 12:20:13.584506 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 126/238] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:20:14.335139 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:14.346211 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:14.346211 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:14.346211 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:14.346211 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:14.346940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:14.346940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:14.346940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:14.358540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:14.358540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:14.363877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:14.364359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:14.364851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:14.368431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:14.368431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:14.368431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:14.543073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:14.547184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:14.551490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3c8dbb20-71d1-4cc2-8d99-fb51f478dd11 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.220311 Aug 12 12:20:14.552057 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 113/239] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:14 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:14.555277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:14.556816 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:14.557946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7223f360-1559-4676-8c75-be8992d3a50c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.208171 Aug 12 12:20:14.558452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 127/240] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:14 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:14.572017 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:14.572614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:14.575108 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:14.575720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:14.578625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:14.579103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:14.579529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:14.580198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:14.580653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:14.581077 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:14.581838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:14.582323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:14.582761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:14.583444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:14.583906 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:14.584333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:14.773005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:14.776249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:14.781322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-28c64269-e5fc-4525-af0c-afead5402811 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.213110 Aug 12 12:20:14.781905 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 114/241] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:14 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:14.784215 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1c3f0698-b9fd-46f9-860c-1891b2a5e782 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.212950 Aug 12 12:20:14.784798 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 128/242] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:14 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:15.572428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:15.573058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:15.580545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:15.581046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:15.581474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:15.581565 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:15.582123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:15.582216 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:15.582587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:15.583006 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:15.588121 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:15.588593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:15.589048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:15.589732 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:15.590158 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:15.590568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:15.776241 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:15.780431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:15.783765 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-70a13964-45ed-4b8c-867c-2d507004ca2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.215276 Aug 12 12:20:15.784332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 115/243] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:15 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:15.788527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:15.790074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:15.791137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-00098fbf-7154-458f-86dc-5bdccb955d19 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.214475 Aug 12 12:20:15.791666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 129/244] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:15 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:15.802392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:15.803097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:15.809351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:15.809950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:15.811552 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:15.811728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:15.812334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:15.813058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:15.813540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:15.813965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:15.816620 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:15.817121 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:15.817547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:15.818218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:15.818661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:15.819079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:16.003258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:16.006610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:16.007467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:16.010813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0ec61aed-3f7b-42a2-9f20-3c9fef86ba10 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.212397 Aug 12 12:20:16.017969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 116/245] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:15 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:16.018076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b5d29a7b-d68b-4692-9856-eb61177d6ed8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.209291 Aug 12 12:20:16.018076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 130/246] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:15 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:16.805039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:16.805649 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:16.813428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:16.814150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:16.814721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:16.815411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:16.815882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:16.816289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:16.817187 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:16.817793 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:16.823739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:16.824225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:16.824672 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:16.825355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:16.825806 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:16.826288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:17.006254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:17.013174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:17.014524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:17.016049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:17.017177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9deec957-623e-4e51-b422-33b4402de774 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.203793 Aug 12 12:20:17.017734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 131/247] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:16 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:17.020884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5e581c5a-03db-4455-8e58-454be438c1da tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.220007 Aug 12 12:20:17.021438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 117/248] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:16 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:17.032968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:17.033579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:17.035528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:17.036134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:17.039737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:17.040220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:17.040670 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:17.041358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:17.041802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:17.042218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:17.042340 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:17.042858 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:17.043367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:17.044094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:17.044586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:17.045802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:17.233903 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:17.237917 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:17.241333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6bb5fa33-1e37-4999-868a-78958f772067 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.214019 Aug 12 12:20:17.242100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 132/249] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:17 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:17.245759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-de967fbf-e0dc-4b9a-8a38-840a5e070bc1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.214078 Aug 12 12:20:17.246398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 118/250] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:17 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:18.040090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:18.040625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:18.043151 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:18.043754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:18.047124 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:18.047606 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:18.048049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:18.048763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:18.049223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:18.049649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:18.049763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:18.050212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:18.050657 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:18.051310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:18.051753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:18.052171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:18.068309 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:18.240882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:18.245013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:18.249734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:18.251231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:18.252320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-04221070-f396-4411-893a-1ad689de606a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.216504 Aug 12 12:20:18.252897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 133/251] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:18 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:18.253022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0112db63-15b8-42f3-83a3-bdfd5dfdeae1 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.213590 Aug 12 12:20:18.253473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 119/252] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:18 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:18.261771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:18.262390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:18.266959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:18.267770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:18.268521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:18.269037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:18.269475 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:18.270156 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:18.270611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:18.271033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:18.273507 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:18.273981 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:18.274406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:18.275107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:18.275543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:18.275960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:18.470978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:18.474656 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:18.481895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d310cc37-65f6-4770-87de-c25b0eedc0b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.223777 Aug 12 12:20:18.482083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-90b22493-8a4c-4a27-b673-8f0f12cd096a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.219271 Aug 12 12:20:18.484839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 120/253] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:18 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:18.484944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 134/254] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:18 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:19.273285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:19.273797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:19.274559 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:19.275156 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:19.280574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:19.281088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:19.281519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:19.282214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:19.282662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:19.283353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:19.283726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:19.284210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:19.284774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:19.285461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:19.285930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:19.286347 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:19.533977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:19.536209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:19.543625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:19.546045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:19.546571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-113c6ea4-d2c6-4da5-8a08-6639c698513b tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.277416 Aug 12 12:20:19.547148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 121/255] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:19 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:19.553924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-429b206b-3c78-40b9-b786-48a45087c454 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.277920 Aug 12 12:20:19.554955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 135/256] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:19 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:19.557467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:19.558073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:19.560783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:19.562570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:19.565288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:19.565776 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:19.566197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:19.566884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:19.567315 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:19.567874 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:19.569628 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:19.570570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:19.571205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:19.571890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:19.572869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:19.573578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:19.794553 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:19.800664 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:19.809068 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ed9f8484-84e8-4d24-94c7-6c9285fafee6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.259647 Aug 12 12:20:19.809320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 122/257] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:19 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:19.823803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4281e3cd-8639-4c66-b79f-20527d18145b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.266515 Aug 12 12:20:19.825016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 136/258] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:19 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:20.570104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:20.570701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:20.577261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:20.577753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:20.578125 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:20.578595 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:20.578842 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:20.579286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:20.579394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:20.579728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:20.585275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:20.585754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:20.586181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:20.586862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:20.587309 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:20.587730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:20.772157 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:20.775469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:20.780438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1399b5f0-87d7-4411-8304-c8ee1b3f6bfb tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.213981 Aug 12 12:20:20.781041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 123/259] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:20 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:20.784385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:20.785980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:20.787166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1311294e-fba5-4a8e-89e0-aedb03746e5b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.213143 Aug 12 12:20:20.788043 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 137/260] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:20 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:20.838163 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:20.838861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:20.845175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:20.845647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:20.846075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:20.846739 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:20.847182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:20.847595 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:20.859076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:20.859682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:20.865669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:20.866150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:20.866580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:20.867257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:20.867702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:20.868118 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:21.043633 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:21.048371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:21.051961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a5e1e762-df08-46f7-bd21-fbfabe76b1f8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.217506 Aug 12 12:20:21.052615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 124/261] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:20 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:21.055900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-eba27f7a-017a-4986-8a09-2f9da9a11a7f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.201191 Aug 12 12:20:21.056458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 138/262] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:20 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:21.803670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:21.805103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:21.809514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:21.811271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:21.815436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:21.815929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:21.816363 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:21.817079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:21.817341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:21.817534 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:21.817814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:21.817957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:21.818264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:21.818966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:21.819409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:21.819824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:22.016675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:22.020832 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:22.024091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5125cb82-e6e4-4120-be3c-234041ac6191 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.226581 Aug 12 12:20:22.024712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 125/263] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:21 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:22.030005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:22.031589 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:22.032746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5246c0ca-aa9b-40c5-ad62-c9880a35099a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.227213 Aug 12 12:20:22.033277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 139/264] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:21 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:22.072038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:22.072372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:22.075886 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:22.077078 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:22.079085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:22.079667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:22.080194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:22.081013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:22.081650 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:22.082223 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:22.082879 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:22.083387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:22.083818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:22.084584 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:22.085055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:22.085472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:22.275849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:22.280567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:22.283921 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a9c06ee2-840d-4ac9-a88f-ad8fdd805aca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.216058 Aug 12 12:20:22.284488 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 126/265] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:22 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:22.288327 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-341464c6-d894-4c72-8de2-b396fe4796aa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.216207 Aug 12 12:20:22.288986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 140/266] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:22 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:23.044495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:23.045285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:23.047148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=99 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:23.051784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:23.052390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:23.055906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:23.055906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:23.055906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:23.055906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:23.059244 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:23.060402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:23.062359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:23.066952 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:23.067428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:23.067862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:23.068536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:23.069009 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:23.069434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:23.258428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:23.262496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:23.266808 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2746fde8-a277-465c-830f-636c88fc7ad7 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.226180 Aug 12 12:20:23.267433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 127/267] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:23 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:23.271417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:23.272994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:23.274098 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3886d7ef-d463-4376-bbac-73ab496d12b2 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.218888 Aug 12 12:20:23.274654 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 141/268] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:23 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:23.304931 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:23.305626 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:23.308915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:23.309563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:23.312817 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:23.313307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:23.313769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:23.314456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:23.314908 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:23.315328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:23.316272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:23.316783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:23.317212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:23.317888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:23.318443 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:23.318944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:23.509706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:23.513724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:23.517654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4e8d04db-c0a4-4022-9242-2792b709d9f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.216460 Aug 12 12:20:23.518218 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 128/269] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:23 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:23.521389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-22a53dea-7843-448c-82e3-e49024b26c54 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.216187 Aug 12 12:20:23.521954 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 142/270] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:23 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:24.287046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:24.287959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:24.294669 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.295184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.295817 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.296334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.296772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.297191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.297347 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:24.298610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:24.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.305244 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.305682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.306402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.306858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.307278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.691799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:24.700507 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:24.710728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a5279c59-0baa-46bb-ad31-1eab183b27a9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1314 microversion: 2.1 time: 0.422633 Aug 12 12:20:24.711375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 129/271] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:24 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:24.725815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:24.726814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:24.729240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:24.732946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:24.734150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d3837781-8392-4be2-a43e-ee5d7a2faa60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.441482 Aug 12 12:20:24.736218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 143/272] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:24 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:20:24.752998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:24.752998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:24.753323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.753323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.753323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.753532 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.753604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.753770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.753770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.753770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.753770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.754047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.754120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.754120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.954746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:24.962114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:24.963189 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fdcd4746-c7fa-4442-94d3-1c68d2169666 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.226601 Aug 12 12:20:24.964499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 144/273] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:24 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:24.969662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-26ba28cf-f82f-44b5-9806-91a6544ed7ab req-56f1024a-8784-4417-ad7c-89ae52b15d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e50626-b455-4357-8ab1-4ed9dea35297", "name": "network-vif-plugged", "status": "completed", "tag": "ea96cc24-3c69-42d6-a3cc-6f2a132e8057"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:20:24.975267 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-86acdcd7-5863-4f2e-8452-6d672e3543f7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.263234 Aug 12 12:20:24.976039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 130/274] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:24 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:24.979324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-26ba28cf-f82f-44b5-9806-91a6544ed7ab req-56f1024a-8784-4417-ad7c-89ae52b15d7e service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:24.979802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-26ba28cf-f82f-44b5-9806-91a6544ed7ab req-56f1024a-8784-4417-ad7c-89ae52b15d7e service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:24.980270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-26ba28cf-f82f-44b5-9806-91a6544ed7ab req-56f1024a-8784-4417-ad7c-89ae52b15d7e service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:24.991230 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-26ba28cf-f82f-44b5-9806-91a6544ed7ab req-56f1024a-8784-4417-ad7c-89ae52b15d7e service nova] Creating event network-vif-plugged:ea96cc24-3c69-42d6-a3cc-6f2a132e8057 for instance 87e50626-b455-4357-8ab1-4ed9dea35297 on hv-cinder-79797 Aug 12 12:20:24.996256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-26ba28cf-f82f-44b5-9806-91a6544ed7ab req-56f1024a-8784-4417-ad7c-89ae52b15d7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030597 Aug 12 12:20:24.996904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 145/275] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:20:25.733162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:25.733881 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:25.740552 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:25.741089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:25.741522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:25.742208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:25.742658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:25.743082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:25.763709 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:25.765073 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:25.771395 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:25.771909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:25.772400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:25.773194 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:25.773765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:25.774190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:25.960375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:25.974069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3bdfb38f-780e-419c-bb36-ba68169549bc tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1502 microversion: 2.1 time: 0.245197 Aug 12 12:20:25.975145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 131/276] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:25 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:25.991524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:25.995996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:26.004033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:26.008308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:26.008826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:26.009310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:26.009994 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:26.010487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:26.010634 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:26.011044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:26.012182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:26.014190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d00eb292-e7e0-43fc-aba7-c59df6dcd297 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.255653 Aug 12 12:20:26.016964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 146/277] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:25 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:26.031664 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:26.032301 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:26.038509 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:26.039152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:26.039805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:26.040852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:26.041542 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:26.042100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:26.234346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:26.240842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:26.241912 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-73fb905d-c4f8-41b6-aca8-fe6d063be711 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.249707 Aug 12 12:20:26.242785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 132/278] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:25 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:26.250193 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8637bfb0-d4dc-4cca-95dd-da0147e5f9bc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.228355 Aug 12 12:20:26.256673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 147/279] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:26 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:27.036135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:27.036745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:27.043117 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:27.043602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:27.044037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:27.044820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:27.045274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:27.045697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:27.063826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:27.171146 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:27.179600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:27.181452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:27.182547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-15062904-04e8-4cff-a4ee-91592aad4df5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.150377 Aug 12 12:20:27.183104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 133/280] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:27 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:27.268010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:27.269320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:27.271809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:27.272624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:27.278602 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:27.279510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:27.279899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:27.280366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:27.280488 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:27.281278 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:27.281410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:27.282133 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:27.282302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:27.282641 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:27.282832 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:27.283453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:27.520392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:27.525997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:27.531235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-65a6d2f7-6ab9-44e3-9c0d-ed2bf6f3ea12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1322 microversion: 2.1 time: 0.268990 Aug 12 12:20:27.531897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 148/281] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:27 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:27.537023 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-09a3a7a2-4907-4c43-b817-d9ceae4ff9bb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.269305 Aug 12 12:20:27.538394 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 134/282] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:27 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:28.205885 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:28.206409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:28.212368 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.212922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.213347 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.214023 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.214477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.214909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.344936 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:28.352855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:28.354356 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:28.355438 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d197b532-f71f-4495-bdb9-289134fbee49 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.154401 Aug 12 12:20:28.355976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 149/283] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:28 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:28.553399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:28.554103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:28.560784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.562291 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.562682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.563386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.563837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.564262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.579878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:28.582942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:28.597939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.598466 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.598914 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.599604 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.600053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.600474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.781814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:28.784759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:28.788534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:28.789898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3d9be730-904c-4140-95b1-ff98304b59f5 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1515 microversion: 2.1 time: 0.240501 Aug 12 12:20:28.790722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 135/284] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:28 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:28.793522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7c106faf-3aa2-40bd-87fb-08900bca8a4b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.224702 Aug 12 12:20:28.795557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 150/285] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:28 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:28.802336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6b5e0aa-7291-4b23-b611-a2506d3c38e6"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:20:28.805160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:28.811158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.811640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.812071 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.812293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:20:28.812804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.813253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.813672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.814678 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:28.825258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.825745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.829275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.829275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:28.829275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:28.829275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:28.893173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lazy-loading 'flavor' on Instance uuid 310fc6f6-2f0e-4103-ab14-95e4175018d6 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:20:29.177282 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8204742b-b7ad-4a5a-b7fa-9bc10803ab98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6/action" status: 200 len: 32 microversion: 2.1 time: 0.369728 Aug 12 12:20:29.177890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 151/286] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:20:28 2022] POST /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6/action => generated 32 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:20:29.187941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:29.188623 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:29.194650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:29.195131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:29.195559 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:29.196231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:29.205003 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:29.205003 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:29.364053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:29.372608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8aa8f169-aaa8-4dea-abfc-ce7e609c0620 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.189044 Aug 12 12:20:29.373197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 152/287] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:29 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:29.380419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:29.380981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:29.387651 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:29.388338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:29.388791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:29.389653 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:29.390505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:29.390927 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:29.555510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:29.563584 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:29.565099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:29.566173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9d647ddd-a5b0-4da1-a795-6ef030880268 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.190250 Aug 12 12:20:29.566726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 153/288] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:29 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:29.819294 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:29.819892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:29.825729 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:29.826222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:29.826628 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:29.827292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:29.827734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:29.828144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:29.960005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:29.970770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-29f92110-12f5-435d-a169-15d769d9d7f0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1365 microversion: 2.1 time: 0.154572 Aug 12 12:20:29.971110 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 154/289] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:29 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:30.395974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:30.396574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:30.402813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:30.403315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:30.403713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:30.404505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:30.405485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:30.406095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:30.583467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:30.595074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8f1de44b-6175-4d0a-9e2b-b42961940b0f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.203004 Aug 12 12:20:30.595649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 155/290] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:30 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:30.600569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:30.601207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:30.607646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:30.615497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:30.615497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:30.615497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:30.615497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:30.616038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:30.779564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:30.788282 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:30.789814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:30.790923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-31a41e34-a110-4625-9bef-9d68d1325253 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1408 microversion: 2.20 time: 0.194187 Aug 12 12:20:30.791478 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 156/291] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:30 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:30.991304 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:30.992046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:30.999295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:30.999899 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:31.000896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:31.001660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:31.002123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:31.002547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:31.201930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:31.207972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d6b81922-da70-40d6-a51a-937e9a9e0b98 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1554 microversion: 2.1 time: 0.220308 Aug 12 12:20:31.208776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 157/292] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:30 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1554 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:20:31.235095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:31.235629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:31.241460 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:31.241929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:31.242356 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:31.243030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:31.243470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:31.243925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:31.472029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-76dee722-8324-47d3-a803-b60b594cb74f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.246550 Aug 12 12:20:31.472604 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 158/293] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 12 12:20:31 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:20:31.617264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:31.619039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:31.626762 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:31.630081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:31.630081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:31.630081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:31.630081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:31.630689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:31.871489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:31.879213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-56da925d-d3f0-43c6-adc8-57eca9710d12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.266814 Aug 12 12:20:31.880041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 159/294] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:31 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:31.884737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:31.885513 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:31.891932 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:31.892403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:31.892857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:31.893542 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:31.893977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:31.894395 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:32.398240 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c3c61409-52d6-46cb-bfb6-0bb5bb02186a tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "POST /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.599389 Aug 12 12:20:32.399894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:32.406603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 136/295] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:20:28 2022] POST /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a/os-volume_attachments => generated 194 bytes in 3615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:20:32.411141 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:32.416795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:32.417988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d9ef000f-fd95-4930-a5f3-1f385e134172 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1600 microversion: 2.20 time: 0.536848 Aug 12 12:20:32.425603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 160/296] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:20:31 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1600 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:20:32.445153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:32.447449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:32.462325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:32.462893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:32.463396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:32.464170 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:32.464956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:32.465860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:32.642343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c69d11bd-f1d6-488a-8875-0b0673cc6a09 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.202460 Aug 12 12:20:32.642895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 137/297] 10.222.0.27 () {60 vars in 1316 bytes} [Fri Aug 12 12:20:32 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:20:32.901836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:32.902259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:32.914547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:32.915057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:32.915498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:32.916226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:32.916634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:32.917117 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:33.317812 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:33.325865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a425d7de-7c00-4d60-ac52-1db7851997a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.427888 Aug 12 12:20:33.329316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 161/298] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:32 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:33.928594 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-fcd697f2-028c-4f38-8f9d-b0b2ad9cf73f req-8895ed2a-0049-4e30-89bf-d0bedf198de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0081c4-5cc9-45f7-b6bb-558b73793525", "tag": "05451aeb-84cb-4518-9499-706bfa3f9ff9"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:20:33.953118 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fcd697f2-028c-4f38-8f9d-b0b2ad9cf73f req-8895ed2a-0049-4e30-89bf-d0bedf198de0 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:33.953827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fcd697f2-028c-4f38-8f9d-b0b2ad9cf73f req-8895ed2a-0049-4e30-89bf-d0bedf198de0 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:33.954440 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fcd697f2-028c-4f38-8f9d-b0b2ad9cf73f req-8895ed2a-0049-4e30-89bf-d0bedf198de0 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:33.965682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-fcd697f2-028c-4f38-8f9d-b0b2ad9cf73f req-8895ed2a-0049-4e30-89bf-d0bedf198de0 service nova] Creating event network-changed:05451aeb-84cb-4518-9499-706bfa3f9ff9 for instance eb0081c4-5cc9-45f7-b6bb-558b73793525 on hv-cinder-79797 Aug 12 12:20:33.971460 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-fcd697f2-028c-4f38-8f9d-b0b2ad9cf73f req-8895ed2a-0049-4e30-89bf-d0bedf198de0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046874 Aug 12 12:20:33.972604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 138/299] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:20:34.350184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:34.350804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:34.356744 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:34.357260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:34.357900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:34.358828 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:34.359428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:34.360005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:34.516119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:34.525388 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bd322f44-7885-4da5-9bbe-e6ca77745e73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.179890 Aug 12 12:20:34.525989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 162/300] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:34 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:35.554993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:35.556414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:35.561958 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:35.562444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:35.562944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:35.563635 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:35.564098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:35.564524 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:35.751549 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:35.759309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-510fc9fa-efbb-4ed6-b37d-4906fc8b4ff9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.209026 Aug 12 12:20:35.759877 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 139/301] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:35 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:35.986592 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-d6227488-4b01-40ef-80cb-6cac12ca108a req-1ad1d26c-02eb-40d4-8d2a-482ecd728ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e50626-b455-4357-8ab1-4ed9dea35297", "tag": "ea96cc24-3c69-42d6-a3cc-6f2a132e8057"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:20:35.995981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-d6227488-4b01-40ef-80cb-6cac12ca108a req-1ad1d26c-02eb-40d4-8d2a-482ecd728ac9 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:35.996454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-d6227488-4b01-40ef-80cb-6cac12ca108a req-1ad1d26c-02eb-40d4-8d2a-482ecd728ac9 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:35.996905 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-d6227488-4b01-40ef-80cb-6cac12ca108a req-1ad1d26c-02eb-40d4-8d2a-482ecd728ac9 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:36.007655 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-d6227488-4b01-40ef-80cb-6cac12ca108a req-1ad1d26c-02eb-40d4-8d2a-482ecd728ac9 service nova] Creating event network-changed:ea96cc24-3c69-42d6-a3cc-6f2a132e8057 for instance 87e50626-b455-4357-8ab1-4ed9dea35297 on hv-cinder-79797 Aug 12 12:20:36.012699 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-d6227488-4b01-40ef-80cb-6cac12ca108a req-1ad1d26c-02eb-40d4-8d2a-482ecd728ac9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030559 Aug 12 12:20:36.013288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 163/302] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:20:36.779471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:36.780068 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:36.786462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:36.792009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:36.792009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:36.792009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:36.792009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:36.792462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:36.925360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:36.934486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a272df0c-cb24-4004-9f2e-d6de5eeb30b6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.158931 Aug 12 12:20:36.935195 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 140/303] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:36 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:37.957857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:37.966360 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:37.968166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:37.968856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:37.969637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:37.970599 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:37.971151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:37.971694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:38.213917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:38.223862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-329ec71f-900f-467b-bd2e-e2fc8ea7f034 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.271137 Aug 12 12:20:38.225425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 164/304] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:37 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:39.244913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:39.245523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:39.252002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:39.252483 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:39.252961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:39.253643 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:39.254094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:39.254516 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:39.389892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:39.397910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7aeca592-1506-41b5-9b50-b61604c9fc48 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.156983 Aug 12 12:20:39.398472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 141/305] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:39 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:40.419571 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:40.420249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:40.427032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:40.427512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:40.427951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:40.428665 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:40.429170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:40.429589 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:40.558657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:40.566487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-25a7f9b5-11b7-4c41-b6ff-fb0df6458f88 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.150904 Aug 12 12:20:40.571628 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 165/306] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:40 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:41.587206 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:41.587804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:41.594259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:41.594732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:41.595157 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:41.595859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:41.596304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:41.596746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:41.720927 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:41.728219 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-395cab10-f739-41f1-a364-e28d16577797 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.144803 Aug 12 12:20:41.728814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 142/307] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:41 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:42.751424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:42.752037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:42.758224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:42.758715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:42.759154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:42.759868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:42.760316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:42.760773 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:42.778748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:42.891409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:42.898719 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5cc8d335-39ba-4493-bb44-3c22e7c86c12 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.152134 Aug 12 12:20:42.899315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 166/308] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:42 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:43.920519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:43.921202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:43.928072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:43.928549 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:43.929061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:43.929685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:43.930130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:43.930544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:44.057101 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:44.065008 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f31bf8e0-8b98-4e1f-9237-e8423ff377da tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.148300 Aug 12 12:20:44.065565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 143/309] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:43 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:45.179106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:45.179106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:45.179106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:45.179106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:45.180498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:45.180498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:45.180498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:45.180498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:45.231120 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:45.238020 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-235b4ef8-5c65-4083-8639-089bf3b03e8b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.156854 Aug 12 12:20:45.238564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 167/310] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:45 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:46.260167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:46.261049 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:46.268174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:46.268677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:46.269113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:46.269794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:46.270253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:46.270675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:46.396457 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:46.404093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2bdb396d-ed9e-4662-baeb-3d14a0803b7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.147876 Aug 12 12:20:46.404676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 144/311] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:46 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:47.425726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:47.426394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:47.433291 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:47.437439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:47.437439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:47.437439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:47.437439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:47.437873 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:47.565920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:47.574014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b19a9eb2-1527-4a8e-8db3-5a364b1156e3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.152198 Aug 12 12:20:47.574014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 168/312] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:47 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:48.595022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:48.596515 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:48.603069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:48.603543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:48.603968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:48.604684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:48.605129 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:48.605546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:48.743632 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:48.750998 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-478b60f7-04bd-4dea-ab1c-c4ed2d075f9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.159965 Aug 12 12:20:48.752076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 145/313] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:48 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:49.774606 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:49.776262 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:49.784896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:49.785453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:49.786011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:49.787002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:49.787570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:49.788069 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:49.950020 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:49.958051 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-57ea6325-0052-4bc7-bede-323c24b3daf4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.189110 Aug 12 12:20:49.962869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 169/314] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:49 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:50.979648 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:50.980178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:50.986979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:50.987566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:50.988023 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:50.988786 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:50.989269 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:50.989715 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:51.143386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:51.151361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5968ea50-dd0f-40cf-a741-88634546aadb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.175502 Aug 12 12:20:51.152140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 146/315] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:50 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:52.174056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:52.174768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:52.180831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:52.181310 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:52.181743 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:52.182421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:52.182869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:52.183420 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:52.360292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:52.370123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8b20d389-5857-4634-9113-030705bd2dcc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.199875 Aug 12 12:20:52.371279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 170/316] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:52 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:52.685524 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:52.686022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:52.693160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:52.693666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:52.694146 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:52.694837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:52.695290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:52.695709 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:52.724153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:20:53.044467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-227e526c-a400-43f6-83ac-4a149316a348 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 204 len: 0 microversion: 2.1 time: 0.362363 Aug 12 12:20:53.045167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 147/317] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:20:52 2022] DELETE /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 12:20:53.054156 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:53.055281 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:53.068579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:53.069112 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:53.069552 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:53.073904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:53.075128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:53.075726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:53.223762 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:53.232216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c484c191-9e9b-4bf2-b1fd-eba622f31241 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1554 microversion: 2.1 time: 0.181801 Aug 12 12:20:53.233119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 171/318] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:53 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:53.392259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:53.393148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:53.395268 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:53.400567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:53.401095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:53.401538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:53.402245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:53.402699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:53.403124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:53.408454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:53.557536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:53.566266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7b17a545-3a88-4d54-a426-319a6603ac7a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.178701 Aug 12 12:20:53.567018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 148/319] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:53 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:54.253659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:54.254332 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:54.256917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=62 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:20:54.261640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:54.262113 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:54.262545 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:54.263809 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:54.264475 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:54.265192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:54.434359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:54.445207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e1e7a28b-633c-433e-b7c8-168d08c8425f tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1554 microversion: 2.1 time: 0.196018 Aug 12 12:20:54.445783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 172/320] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:54 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:54.587538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:54.588156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:54.597164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:54.598077 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:54.598911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:54.599827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:54.600486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:54.601180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:54.736565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:54.744114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3941efcd-8c44-4006-bbb3-d4992aabe624 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.161089 Aug 12 12:20:54.745108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 149/321] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:54 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:55.466716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:55.467329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:55.473963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:55.474410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:55.474839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:55.475521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:55.475968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:55.476388 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:55.674619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:55.682804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ace1c8a1-38fe-43d4-a0e4-33ce770d24c8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1554 microversion: 2.1 time: 0.219934 Aug 12 12:20:55.683370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 173/322] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:55 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:55.765665 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:55.766263 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:55.773360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:55.773926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:55.774477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:55.775175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:55.775621 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:55.776035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:55.947266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:55.955651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-44b17cc1-ad3d-4008-b264-2730fbff9512 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.194517 Aug 12 12:20:55.956140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 150/323] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:55 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:56.703226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:56.703831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:56.710037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:56.710555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:56.720203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:56.720203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:56.720203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:56.720203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:56.845413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:56.854407 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-daa48ace-a141-4a2d-929f-3625b842409e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1554 microversion: 2.1 time: 0.155023 Aug 12 12:20:56.854962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 174/324] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:56 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:56.977476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:56.978106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:56.985142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:56.985622 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:56.986056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:56.986742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:56.987827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:56.988403 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:57.119081 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:57.126528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ae301160-2ec5-4bef-ac8e-bb0ee396a6a0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.153171 Aug 12 12:20:57.127224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 151/325] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:56 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:57.876152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:57.877102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:57.884069 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:57.884676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:57.885101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:57.885779 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:57.886226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:57.886660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:58.043591 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:58.052677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-32a5e2d8-b563-4f47-ac6d-a3619f084a2c tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1554 microversion: 2.1 time: 0.180928 Aug 12 12:20:58.053362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 175/326] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:57 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:58.148348 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:58.149569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:58.156074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:58.159473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:58.159473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:58.159473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:58.159473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:58.159828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:58.297019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:58.304764 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ee582450-aece-40ff-8f43-d8dc9543fc9c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.160554 Aug 12 12:20:58.305327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 152/327] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:58 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:59.076164 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:59.076805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:59.082887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:59.083376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:59.083842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:59.084501 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:59.084991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:59.085415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:59.216153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:59.225476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2a33efda-4f88-4c47-9552-03d6ae3feec3 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1554 microversion: 2.1 time: 0.153075 Aug 12 12:20:59.226041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 176/328] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:59 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:20:59.325403 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:20:59.326049 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:20:59.332686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:59.333165 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:59.333599 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:59.334272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:20:59.334715 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:20:59.335131 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:20:59.603389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:20:59.610931 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8df23b81-adb7-4d98-aa16-bbdc995d66ec tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.289954 Aug 12 12:20:59.612022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 153/329] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:20:59 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:00.247192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:00.247802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:00.253790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:00.254274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:00.254749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:00.255456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:00.255911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:00.256340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:00.382994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:00.392134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a8f2284e-a4e8-4381-9d23-71c5a9f89f51 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1554 microversion: 2.1 time: 0.148772 Aug 12 12:21:00.393637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 177/330] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:00 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:00.631871 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:00.632604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:00.639531 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:00.643361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:00.643361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:00.643361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:00.643361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:00.643716 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:00.813170 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:00.821409 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7ea07546-e729-4f87-a24a-58e4f2a18150 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.193459 Aug 12 12:21:00.821977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 154/331] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:00 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:01.402755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1390444596", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "networks": [{"uuid": "2026b3cc-8e9b-4233-a93b-1d2daaa79b74"}]}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:01.414465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:01.415266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:01.421605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:01.422643 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:01.424324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:01.425203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:01.427351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:01.427351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:01.496232 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] validate_networks() for [('2026b3cc-8e9b-4233-a93b-1d2daaa79b74', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:21:01.644066 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:01.655584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9e170b0e-7d41-4173-8207-1acdee6defc8 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1512 microversion: 2.1 time: 0.245720 Aug 12 12:21:01.656360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 155/332] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:01 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:01.691510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-92a1c521-1ede-4c14-9910-33a04c821003 req-beab8b70-dbeb-4f37-a86e-681e2a3d2f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d672f6c-0e6a-4766-b695-2e8cd409203a", "name": "network-vif-deleted", "tag": "f95508bc-6fcf-40e6-bb4d-c949474b82d5"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:01.706774 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-92a1c521-1ede-4c14-9910-33a04c821003 req-beab8b70-dbeb-4f37-a86e-681e2a3d2f81 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:01.707244 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-92a1c521-1ede-4c14-9910-33a04c821003 req-beab8b70-dbeb-4f37-a86e-681e2a3d2f81 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:01.707667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-92a1c521-1ede-4c14-9910-33a04c821003 req-beab8b70-dbeb-4f37-a86e-681e2a3d2f81 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:01.719396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-92a1c521-1ede-4c14-9910-33a04c821003 req-beab8b70-dbeb-4f37-a86e-681e2a3d2f81 service nova] Creating event network-vif-deleted:f95508bc-6fcf-40e6-bb4d-c949474b82d5 for instance 1d672f6c-0e6a-4766-b695-2e8cd409203a on hv-cinder-79797 Aug 12 12:21:01.726619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-92a1c521-1ede-4c14-9910-33a04c821003 req-beab8b70-dbeb-4f37-a86e-681e2a3d2f81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037529 Aug 12 12:21:01.726619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 156/333] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:21:01.842945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:01.843825 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:01.850463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:01.851338 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:01.852144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:01.852945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:01.853461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:01.853892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:02.066766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:21:02.067219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:21:02.067708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:21:02.068804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:21:02.069224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:21:02.071392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:02.079132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:02.079315 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-caf7e02c-d35e-4ff9-b283-1d10826b747d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.240448 Aug 12 12:21:02.079616 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:02.080686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:02.081126 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 157/334] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:01 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:02.081294 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:02.081514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:02.081941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:02.099322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Getting quotas for project 8164da757959471cbbfb3b51af1edebd. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:21:02.103378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Getting quotas for user 011f5d15687d4a55ac595c8f067d6f1d and project 8164da757959471cbbfb3b51af1edebd. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:21:02.114936 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:21:02.117217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:21:02.232846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-89ffb4a4-bc74-4e1a-babe-bb8a0a769b19 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833767 Aug 12 12:21:02.239801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 178/335] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:21:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:21:02.246042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cb4b36ca-c10d-4571-8fdd-c22b248989e1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:02.252830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cb4b36ca-c10d-4571-8fdd-c22b248989e1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:02.319370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cb4b36ca-c10d-4571-8fdd-c22b248989e1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:02.340453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cb4b36ca-c10d-4571-8fdd-c22b248989e1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1214 microversion: 2.1 time: 0.095539 Aug 12 12:21:02.340453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 158/336] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:02 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:02.679380 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:02.679993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:02.686897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:02.687442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:02.687889 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:02.688611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:02.689102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:02.689592 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:02.719644 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:02.720114 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:02.721485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:02.721943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lazy-loading 'fault' on Instance uuid 1d672f6c-0e6a-4766-b695-2e8cd409203a {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:21:02.770930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bc7ffa8e3cf49fe9dcd8471c25be83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a765c7ccb93545e0a90bc7ffc23a0d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:02.779590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2cb2d69a-6201-4d03-9ac4-4d3a938cc25e tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 200 len: 1350 microversion: 2.1 time: 0.104266 Aug 12 12:21:02.780188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 179/337] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:02 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:03.100804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:03.101489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:03.108076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:03.108560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:03.109096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:03.109786 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:03.110248 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:03.110676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:03.245506 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:03.254311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e08c5119-d23f-4ce5-b265-c4e0b7d378d8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.157356 Aug 12 12:21:03.256682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 159/338] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:03 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:03.363668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:03.364271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:03.370142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:03.370617 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:03.374439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:03.374439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:03.374439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:03.374439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:03.449257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:03.460757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a394d8cd-e4e8-4388-9c23-a0f998e52cd3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1218 microversion: 2.1 time: 0.099400 Aug 12 12:21:03.460757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 180/339] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:03 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:03.802033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:03.802645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:03.808965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:03.810598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:03.810598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:03.810820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:03.811168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:03.811614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:03.833207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] HTTP exception thrown: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Request method failure captured: Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a HTTP/1.1 Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kUz1PZRH6QD70pSVRi3klUshO2OQBlcJzB2i0Sp7vaayRV0ukNKlv8sT2mezYutCaTCGVYXO8h31VxnUfYg1A-bP8Qc7YqiPQhdYXbh0VCNhm11GuvDXxzChGkcTHWKr1cJ7AidDofIRnO2s170jHAe-AlxDa4zS86rhQABve-q9mI Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: a765c7ccb93545e0a90bc7ffc23a0d46 Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:21:03.835708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a765c7ccb93545e0a90bc7ffc23a0d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a765c7ccb93545e0a90bc7ffc23a0d46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a765c7ccb93545e0a90bc7ffc23a0d46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a765c7ccb93545e0a90bc7ffc23a0d46"}]}] Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: a765c7ccb93545e0a90bc7ffc23a0d46 Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-DeleteServersTestJSON-2055013068-project Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 9bc7ffa8e3cf49fe9dcd8471c25be83a Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-DeleteServersTestJSON-2055013068-project Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:03.837064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '1d672f6c-0e6a-4766-b695-2e8cd409203a'} Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:21:03.837829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:03.839142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:03.840576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Returning 404 to user: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:21:03.840576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cc6b5309-e2df-4032-a5be-baf471786da5 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 404 len: 111 microversion: 2.1 time: 0.040242 Aug 12 12:21:03.840576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 160/340] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:03 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:21:03.982953 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:03.985307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:03.992877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:03.998483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:03.998483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:03.998483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:03.998483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:03.998815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:04.008997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] HTTP exception thrown: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Request method failure captured: Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a/os-volume_attachments HTTP/1.1 Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kUz1PZRH6QD70pSVRi3klUshO2OQBlcJzB2i0Sp7vaayRV0ukNKlv8sT2mezYutCaTCGVYXO8h31VxnUfYg1A-bP8Qc7YqiPQhdYXbh0VCNhm11GuvDXxzChGkcTHWKr1cJ7AidDofIRnO2s170jHAe-AlxDa4zS86rhQABve-q9mI Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: a765c7ccb93545e0a90bc7ffc23a0d46 Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:21:04.013150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a765c7ccb93545e0a90bc7ffc23a0d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a765c7ccb93545e0a90bc7ffc23a0d46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a765c7ccb93545e0a90bc7ffc23a0d46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a765c7ccb93545e0a90bc7ffc23a0d46"}]}] Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: a765c7ccb93545e0a90bc7ffc23a0d46 Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-DeleteServersTestJSON-2055013068-project Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 9bc7ffa8e3cf49fe9dcd8471c25be83a Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-DeleteServersTestJSON-2055013068-project Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:04.014479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'server_id': '1d672f6c-0e6a-4766-b695-2e8cd409203a'} Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:21:04.015355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:04.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:04.018950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Returning 404 to user: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:21:04.018950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6f594a24-b06e-404d-8c7b-277db3ffafd9 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035683 Aug 12 12:21:04.018950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 181/341] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:21:03 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:21:04.279989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:04.281340 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:04.288050 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:04.288798 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:04.289308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:04.290651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:04.291276 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:04.291777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:04.459346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:04.466860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b72190a9-e91e-47a0-b059-b90048aa31ef tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.190758 Aug 12 12:21:04.467418 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 161/342] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:04 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:04.480161 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:04.480827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:04.489805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:04.490449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:04.491170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:04.492107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:04.492762 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:04.493308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:04.564882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:04.568021 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3f47fe70-bc71-4384-8882-f4818cb27951 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1266 microversion: 2.1 time: 0.091818 Aug 12 12:21:04.568588 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 182/343] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:04 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:05.390820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:05.391321 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:05.400185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:05.400883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:05.401316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:05.402004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:05.402449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:05.402868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:05.417921 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] HTTP exception thrown: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Request method failure captured: Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: DELETE /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a HTTP/1.1 Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kUz1PZRH6QD70pSVRi3klUshO2OQBlcJzB2i0Sp7vaayRV0ukNKlv8sT2mezYutCaTCGVYXO8h31VxnUfYg1A-bP8Qc7YqiPQhdYXbh0VCNhm11GuvDXxzChGkcTHWKr1cJ7AidDofIRnO2s170jHAe-AlxDa4zS86rhQABve-q9mI Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: a765c7ccb93545e0a90bc7ffc23a0d46 Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:21:05.419474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a765c7ccb93545e0a90bc7ffc23a0d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a765c7ccb93545e0a90bc7ffc23a0d46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a765c7ccb93545e0a90bc7ffc23a0d46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a765c7ccb93545e0a90bc7ffc23a0d46"}]}] Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: a765c7ccb93545e0a90bc7ffc23a0d46 Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-DeleteServersTestJSON-2055013068-project Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 9bc7ffa8e3cf49fe9dcd8471c25be83a Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-DeleteServersTestJSON-2055013068-project Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.422876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '1d672f6c-0e6a-4766-b695-2e8cd409203a'} Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:21:05.423708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.426005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.427816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Returning 404 to user: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:21:05.427816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8cd17bc9-03ac-4405-92ef-97d5be854049 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 404 len: 111 microversion: 2.1 time: 0.034611 Aug 12 12:21:05.428369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 162/344] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:21:05 2022] DELETE /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:21:05.433859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:05.434476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] [instance: 1d672f6c-0e6a-4766-b695-2e8cd409203a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:05.440957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:05.442185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:05.442687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:05.443457 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:05.443979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:05.444566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:05.458831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] HTTP exception thrown: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Request method failure captured: Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a HTTP/1.1 Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kUz1PZRH6QD70pSVRi3klUshO2OQBlcJzB2i0Sp7vaayRV0ukNKlv8sT2mezYutCaTCGVYXO8h31VxnUfYg1A-bP8Qc7YqiPQhdYXbh0VCNhm11GuvDXxzChGkcTHWKr1cJ7AidDofIRnO2s170jHAe-AlxDa4zS86rhQABve-q9mI Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: a765c7ccb93545e0a90bc7ffc23a0d46 Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:21:05.461012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a765c7ccb93545e0a90bc7ffc23a0d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a765c7ccb93545e0a90bc7ffc23a0d46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a765c7ccb93545e0a90bc7ffc23a0d46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a765c7ccb93545e0a90bc7ffc23a0d46"}]}] Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: a765c7ccb93545e0a90bc7ffc23a0d46 Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055013068 Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-DeleteServersTestJSON-2055013068-project Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 9bc7ffa8e3cf49fe9dcd8471c25be83a Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-DeleteServersTestJSON-2055013068-project Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.462319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '1d672f6c-0e6a-4766-b695-2e8cd409203a'} Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:21:05.462975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. Aug 12 12:21:05.464373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:05.465479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] Returning 404 to user: Instance 1d672f6c-0e6a-4766-b695-2e8cd409203a could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:21:05.465479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f89e9015-dffa-406c-a017-53da4fb7c662 tempest-DeleteServersTestJSON-2055013068 tempest-DeleteServersTestJSON-2055013068-project] 10.222.0.27 "GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a" status: 404 len: 111 microversion: 2.1 time: 0.032761 Aug 12 12:21:05.465479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 183/345] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:05 2022] GET /compute/v2.1/servers/1d672f6c-0e6a-4766-b695-2e8cd409203a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:21:05.488812 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:05.489434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:05.500953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:05.501493 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:05.502162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:05.503091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:05.503765 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:05.504358 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:05.594699 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:05.596681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:05.613410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:05.613898 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:05.614333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:05.615041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:05.615503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:05.615926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:05.728933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:05.738456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:05.741688 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1ca93c8c-37ab-4e6f-85ec-973f3eacea35 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1272 microversion: 2.1 time: 0.155971 Aug 12 12:21:05.744558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 184/346] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:05 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:05.759426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:05.766972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4924fbdb-88e1-43d5-ae54-f7191afb0e82 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.282850 Aug 12 12:21:05.767837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 163/347] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:05 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:06.762868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:06.763774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:06.771223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:06.771704 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:06.772390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:06.773277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:06.773844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:06.774337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:06.791040 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:06.792446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:06.812227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:06.812915 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:06.813540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:06.814632 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:06.815268 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:06.816072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:07.104806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:07.115224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-892ab423-03f1-4349-a272-5db8726b489d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.330225 Aug 12 12:21:07.115524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:07.116356 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 164/348] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:06 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:07.121454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-8523a008-fcb1-4243-b416-37a58016aac2 req-c7e31d72-30e6-4882-ba31-a803d03bc64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb59180-f663-4e7f-aa6f-17b5c08d5630", "tag": "f58a49df-211c-4fc8-b126-41cb9c2f3a47"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:07.129403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-222ec64e-1f6e-4d71-b643-916cfab95b03 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1314 microversion: 2.1 time: 0.369392 Aug 12 12:21:07.129989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 185/349] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:06 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:07.136263 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8523a008-fcb1-4243-b416-37a58016aac2 req-c7e31d72-30e6-4882-ba31-a803d03bc64d service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:07.136990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8523a008-fcb1-4243-b416-37a58016aac2 req-c7e31d72-30e6-4882-ba31-a803d03bc64d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:07.137608 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8523a008-fcb1-4243-b416-37a58016aac2 req-c7e31d72-30e6-4882-ba31-a803d03bc64d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:07.154052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-8523a008-fcb1-4243-b416-37a58016aac2 req-c7e31d72-30e6-4882-ba31-a803d03bc64d service nova] Creating event network-changed:f58a49df-211c-4fc8-b126-41cb9c2f3a47 for instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 on hv-cinder-79797 Aug 12 12:21:07.161016 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-8523a008-fcb1-4243-b416-37a58016aac2 req-c7e31d72-30e6-4882-ba31-a803d03bc64d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042598 Aug 12 12:21:07.161908 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 165/350] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:21:08.137079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:08.137773 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:08.147610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:08.148230 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:08.149878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:08.150832 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:08.151924 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:08.152780 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:08.153368 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:08.154218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:08.162616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:08.163116 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:08.165850 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:08.166954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:08.167029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:08.167443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:08.555020 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:08.558869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:08.563944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1ef14813-7396-4457-81a2-e471ba6c0611 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.431209 Aug 12 12:21:08.564526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 186/351] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:08 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:08.581186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f03c3aa1-8d27-4996-ac60-44c04bfd66b0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1314 microversion: 2.1 time: 0.433959 Aug 12 12:21:08.581761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 166/352] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:08 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:09.587899 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:09.589257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:09.599507 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:09.600019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:09.600666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:09.601390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:09.602385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:09.602817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:09.602966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:09.603103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:09.609552 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:09.610312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:09.610691 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:09.611379 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:09.611855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:09.612283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:09.894996 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:09.901246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a3beb2b5-4abe-475e-972e-802c34da0c2b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.318629 Aug 12 12:21:09.910202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:09.913326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 187/353] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:09 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:09.921996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-587d4b2c-eedd-4db3-9a18-76b8d254a8a9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1314 microversion: 2.1 time: 0.323574 Aug 12 12:21:09.922578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 167/354] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:09 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:10.926042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:10.927359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:10.941004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:10.943418 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:10.943775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:10.946275 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:10.953341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:10.957695 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:10.958242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:10.958973 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:10.960339 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:10.961076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:10.961747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:10.964321 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:10.965029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:10.968525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:11.033504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:11.237066 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:11.249392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:11.266575 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-657ed23d-d916-443c-8846-28976e974312 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.344890 Aug 12 12:21:11.269160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b5055f64-14c2-4f31-a35c-a5e2553e75fb tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1314 microversion: 2.1 time: 0.324269 Aug 12 12:21:11.277473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 168/355] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:10 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:11.290746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 188/356] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:10 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:12.290777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:12.291456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:12.300140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:12.300993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:12.304881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:12.304881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=6 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:12.309585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:12.310282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:12.310900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:12.316140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:12.316899 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:12.317341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:12.318042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:12.321493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:12.324179 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:12.325186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:12.327876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:12.327876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:12.347867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:12.649091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:12.657140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-92e1eb4d-ac3c-4f63-b265-ede069275137 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1314 microversion: 2.1 time: 0.370231 Aug 12 12:21:12.657998 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 169/357] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:12 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:12.660702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:12.673960 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2b25509a-c74d-4f8c-9341-cac150cfae22 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.379191 Aug 12 12:21:12.675590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 189/358] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:12 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:13.254160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-1fff5b77-e7cc-4ad6-95f1-6ad1c7af4e85 req-1393bb27-fad5-412c-8564-6297dac0ab99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb59180-f663-4e7f-aa6f-17b5c08d5630", "name": "network-vif-plugged", "status": "completed", "tag": "f58a49df-211c-4fc8-b126-41cb9c2f3a47"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:13.264609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1fff5b77-e7cc-4ad6-95f1-6ad1c7af4e85 req-1393bb27-fad5-412c-8564-6297dac0ab99 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:13.265281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1fff5b77-e7cc-4ad6-95f1-6ad1c7af4e85 req-1393bb27-fad5-412c-8564-6297dac0ab99 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:13.265788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1fff5b77-e7cc-4ad6-95f1-6ad1c7af4e85 req-1393bb27-fad5-412c-8564-6297dac0ab99 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:13.278532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-1fff5b77-e7cc-4ad6-95f1-6ad1c7af4e85 req-1393bb27-fad5-412c-8564-6297dac0ab99 service nova] Creating event network-vif-plugged:f58a49df-211c-4fc8-b126-41cb9c2f3a47 for instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 on hv-cinder-79797 Aug 12 12:21:13.285511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-1fff5b77-e7cc-4ad6-95f1-6ad1c7af4e85 req-1393bb27-fad5-412c-8564-6297dac0ab99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036114 Aug 12 12:21:13.286610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 170/359] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:21:13.679695 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:13.681372 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:13.688173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:13.688718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:13.689157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:13.690621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:13.691253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:13.692336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:13.698791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:13.700069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:13.708151 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:13.710901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:13.710901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:13.710901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:13.710901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:13.711202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:13.996790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:14.005778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3addf6b2-c55e-4e70-bab0-7411dac62d59 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1314 microversion: 2.1 time: 0.330686 Aug 12 12:21:14.006567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 190/360] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:13 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:14.033773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:14.042344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-01e22587-896c-4650-8902-6b189ed50571 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1521 microversion: 2.1 time: 0.349171 Aug 12 12:21:14.043162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 171/361] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:13 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:15.027417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:15.028834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:15.035956 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:15.036827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:15.037479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:15.038416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:15.039097 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:15.039728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:15.069015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:15.070494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:15.086454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:15.087459 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:15.090680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:15.091692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:15.093197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:15.095767 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:15.410272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:15.411893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:15.436001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-94b08f51-729a-461b-bdf0-1e595885380c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1501 microversion: 2.1 time: 0.359166 Aug 12 12:21:15.436001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 172/362] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:15 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1501 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:15.444576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:15.445874 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:15.454526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-476d5b73-6083-4d0a-9855-5aecfb9d2866 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1314 microversion: 2.1 time: 0.430955 Aug 12 12:21:15.456914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:15.458923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:15.459617 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 191/363] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:15 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:15.461164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:15.463731 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:15.464613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:15.465311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:15.656633 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:15.665421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f337d5ce-d81d-45e9-a804-baabf76645b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1514 microversion: 2.1 time: 0.228103 Aug 12 12:21:15.680760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 173/364] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:15 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:16.478786 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:16.479654 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:16.490458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:16.491245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:16.491694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:16.492481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:16.496908 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:16.497537 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:16.701548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:16.710346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ca693927-2cf2-4bcc-b32f-3ace6a23c686 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1314 microversion: 2.1 time: 0.238795 Aug 12 12:21:16.721208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 192/365] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:16 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:17.733995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:17.735229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:17.755123 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:17.755901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:17.756457 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:17.757995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:17.758605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:17.759176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:18.000555 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:18.017045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-614d2aee-9748-45fb-9d38-fe8a8446bae7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1497 microversion: 2.1 time: 0.288088 Aug 12 12:21:18.017778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 174/366] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:17 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:18.664853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:18.667488 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:18.673947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:18.674596 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:18.675155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:18.676076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:18.676835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:18.677366 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:18.722646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lazy-loading 'flavor' on Instance uuid 2e3556b5-b492-4712-ae79-c1cfea75596f {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:21:19.149846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cd550668-a5b7-4864-9d37-ae56fd57b97b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f/action" status: 200 len: 32 microversion: 2.1 time: 0.489483 Aug 12 12:21:19.150708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 193/367] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:21:18 2022] POST /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f/action => generated 32 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:21:19.161323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:19.161937 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:19.177036 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:19.179799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:19.179799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:19.179799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:19.179799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:19.181155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:19.362283 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:19.370651 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:19.389398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:19.390147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:19.391169 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:19.393721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:19.394529 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:19.395147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:19.445749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Going to try to terminate instance {{(pid=121154) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:21:19.449330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:19.458264 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5baccd5b-7f78-4945-acd1-874cde854a38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.301541 Aug 12 12:21:19.458936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 175/368] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:19 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:19.907440 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c7e4b792-5ced-4450-b1ae-a72c746eaed9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 204 len: 0 microversion: 2.1 time: 0.569413 Aug 12 12:21:19.912853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 194/369] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:21:19 2022] DELETE /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:21:19.932574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:19.933225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:19.940391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:19.943837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:19.943837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:19.943837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:19.943837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:19.944141 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:20.286258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:20.299675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0c9e6f61-0948-4dd8-8532-3cfb4d6f838b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1503 microversion: 2.1 time: 0.380254 Aug 12 12:21:20.324106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 176/370] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:19 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:20.480193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:20.481782 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:20.490948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:20.493176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:20.493822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:20.495052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:20.495518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:20.496321 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:20.586643 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-550f0a1d-d143-40d6-bdb5-af1edc1d717c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'create', calling method: .version_select at 0x7f99140d91f0>, body: {"keypair": {"name": "tempest-keypair-1578463955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7ACdBNTUfCZMzGkn9s1wSOsWqhBY0NjM3DLT3xqFVejJxyw+VXPhxnpxxlgKxZThu6szDWZZXlN1don/13ydneLDLQY6aigjLWyiwG2+cnJfoCi6GroLcycMSm/Ya0vA=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:20.605745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-550f0a1d-d143-40d6-bdb5-af1edc1d717c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Getting quotas for project c0fbadb872e74c57813900e5ebb6ac88. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:21:20.610204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-550f0a1d-d143-40d6-bdb5-af1edc1d717c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Getting quotas for user d3f9fac4e1de488b9964f988d238483a and project c0fbadb872e74c57813900e5ebb6ac88. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:21:20.671620 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:20.679079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-24aea0ac-068e-4a86-ba9d-42e15589195a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.203614 Aug 12 12:21:20.682484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 177/371] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:20 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:20.702707 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-550f0a1d-d143-40d6-bdb5-af1edc1d717c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.274974 Aug 12 12:21:20.705898 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 195/372] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:21:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:21:21.327286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:21.327894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:21.339158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:21.339641 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:21.340357 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:21.341226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:21.341815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:21.342374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:21.577544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:21.585541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7d7fa3c3-4364-4026-9ae6-c8f3506c833c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1503 microversion: 2.1 time: 0.262052 Aug 12 12:21:21.602484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 178/373] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:21 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:21.700238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:21.701064 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:21.708323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:21.708841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:21.709274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:21.710118 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:21.710561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:21.711011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:21.912483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:21.921325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-23e6f985-376b-4b03-b094-133b24af4805 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.225698 Aug 12 12:21:21.922145 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 196/374] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:21 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:22.607613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:22.608688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:22.616484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:22.617188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:22.617793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:22.618850 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:22.619405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:22.620168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:22.944988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:22.946233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:22.947005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:22.955637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:22.957663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:22.958365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:22.959861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:22.961342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:22.962006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:22.968887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ed03ff57-d7ee-4035-bc37-37b9ceb8b743 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1503 microversion: 2.1 time: 0.365683 Aug 12 12:21:22.983453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 179/375] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:22 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:23.205417 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-7d35636b-c2e8-41eb-8a1a-d8af8db2352f req-858796b6-946d-42e7-bf7f-6c4d74dcccec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb59180-f663-4e7f-aa6f-17b5c08d5630", "name": "network-vif-deleted", "tag": "f58a49df-211c-4fc8-b126-41cb9c2f3a47"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:23.221390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7d35636b-c2e8-41eb-8a1a-d8af8db2352f req-858796b6-946d-42e7-bf7f-6c4d74dcccec service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:23.222459 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7d35636b-c2e8-41eb-8a1a-d8af8db2352f req-858796b6-946d-42e7-bf7f-6c4d74dcccec service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:23.224966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7d35636b-c2e8-41eb-8a1a-d8af8db2352f req-858796b6-946d-42e7-bf7f-6c4d74dcccec service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:23.243965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-7d35636b-c2e8-41eb-8a1a-d8af8db2352f req-858796b6-946d-42e7-bf7f-6c4d74dcccec service nova] Creating event network-vif-deleted:f58a49df-211c-4fc8-b126-41cb9c2f3a47 for instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 on hv-cinder-79797 Aug 12 12:21:23.250902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-7d35636b-c2e8-41eb-8a1a-d8af8db2352f req-858796b6-946d-42e7-bf7f-6c4d74dcccec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051362 Aug 12 12:21:23.260067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 180/376] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:21:23.395576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:23.419927 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-879507983", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "networks": [{"uuid": "e854be93-724c-4f27-a3be-35ae1178b4d2"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:23.420950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6b87a8c1-61d0-4208-8911-bb24b947e80f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.480781 Aug 12 12:21:23.421926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 197/377] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:22 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:23.990203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:23.990856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:23.997127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:23.997622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:23.998049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:23.998740 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:23.999182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:23.999758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:24.041176 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:24.041667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:24.042106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:24.042559 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lazy-loading 'fault' on Instance uuid 1cb59180-f663-4e7f-aa6f-17b5c08d5630 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:21:24.046277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:24.090739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:24.100438 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c1627628-d290-4787-a12f-a57f31720e24 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 200 len: 1304 microversion: 2.1 time: 0.114239 Aug 12 12:21:24.101199 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 198/378] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:23 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:24.106283 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-273095410", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b734a92-a8fa-4136-b234-6c77076a2fd0"}], "security_groups": [{"name": "tempest-securitygroup--1883041826"}], "key_name": "tempest-keypair-1578463955", "user_data": "}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:25.663512 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] validate_networks() for [('e854be93-724c-4f27-a3be-35ae1178b4d2', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:21:25.781139 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] validate_networks() for [('7b734a92-a8fa-4136-b234-6c77076a2fd0', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:21:26.088442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:26.250886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:21:26.251513 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:21:26.251981 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:21:26.252383 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:21:26.258525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:21:26.260969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=70 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:26.269819 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:26.270302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:26.270737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:26.271510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:26.271956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:26.272378 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:26.291366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Getting quotas for project f1b3e4986e72478bb46a86e1e9e3355c. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:21:26.295445 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Getting quotas for user 07db808b777b4407ac05f3f0fa2394f8 and project f1b3e4986e72478bb46a86e1e9e3355c. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:21:26.307885 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:21:26.310453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:21:26.356307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:21:26.356958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:21:26.357552 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:21:26.358077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:21:26.358551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:21:26.368423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:26.368936 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:26.369369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:26.370087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:26.370536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:26.370957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:26.387821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Getting quotas for project c0fbadb872e74c57813900e5ebb6ac88. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:21:26.391756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Getting quotas for user d3f9fac4e1de488b9964f988d238483a and project c0fbadb872e74c57813900e5ebb6ac88. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:21:26.402728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:21:26.404998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:21:26.435708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1848e3a9-6c68-4dd5-928a-3cf0114ca5f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.023426 Aug 12 12:21:26.436453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 181/379] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:21:26.441555 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:26.442237 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:26.450219 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:26.450795 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:26.451297 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:26.452083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:26.452600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:26.453248 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:26.514716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ef765c8c-9068-4f1d-8006-15098aa79493 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.412555 Aug 12 12:21:26.515496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 199/380] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:21:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:21:26.526931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:26.527805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: 1cb59180-f663-4e7f-aa6f-17b5c08d5630] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:26.535823 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:26.536604 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:26.537513 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:26.538302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:26.538842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:26.539389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:26.555641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] HTTP exception thrown: Instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 could not be found. Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Request method failure captured: Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 HTTP/1.1 Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kWm35Qh1F_EV2ysCC9bQN6VbZIHqAO5oWN9NGn4UAUUX7RY_SvqanHIvCYuyqPzli3nzpvJaidXuuaQoPlFnRerCt4lVK1ZRfAR_klvap-T0KYtnOngxgBwn2z2lRpQyEJreIrMs4Ls5EY_zsdyt6uuiBpI2l0TDQ1V9zeuf4gTwVc Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 8164da757959471cbbfb3b51af1edebd Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesActionsTest-996623237 Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:21:26.557883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8164da757959471cbbfb3b51af1edebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8164da757959471cbbfb3b51af1edebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8164da757959471cbbfb3b51af1edebd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8164da757959471cbbfb3b51af1edebd"}]}] Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesActionsTest-996623237 Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 8164da757959471cbbfb3b51af1edebd Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesActionsTest-996623237 Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesActionsTest-996623237-project Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 011f5d15687d4a55ac595c8f067d6f1d Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesActionsTest-996623237-project Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 could not be found. Aug 12 12:21:26.559105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '1cb59180-f663-4e7f-aa6f-17b5c08d5630'} Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 could not be found. Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:21:26.559775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 could not be found. Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 could not be found. Aug 12 12:21:26.560875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:26.561827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Returning 404 to user: Instance 1cb59180-f663-4e7f-aa6f-17b5c08d5630 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:21:26.561827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a2ee811a-159d-475d-b477-33870e16a996 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630" status: 404 len: 111 microversion: 2.1 time: 0.038716 Aug 12 12:21:26.574518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 200/381] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:26 2022] GET /compute/v2.1/servers/1cb59180-f663-4e7f-aa6f-17b5c08d5630 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:21:26.574518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2f710a36-2367-4fe9-b1cd-6f3278a3d59a tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:26.581503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2f710a36-2367-4fe9-b1cd-6f3278a3d59a tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:26.619424 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:26.632603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f1c62e20-1f8a-4bcc-b9ba-e0c98f4e7d89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.194387 Aug 12 12:21:26.634496 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 182/382] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:26 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:26.644851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c96a182f-48dd-47c5-832f-695030dc03b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:26.645476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c96a182f-48dd-47c5-832f-695030dc03b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:26.698274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2f710a36-2367-4fe9-b1cd-6f3278a3d59a tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:26.715793 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2f710a36-2367-4fe9-b1cd-6f3278a3d59a tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1218 microversion: 2.1 time: 0.145173 Aug 12 12:21:26.716498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 201/383] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:26 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:26.754314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c96a182f-48dd-47c5-832f-695030dc03b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:26.761892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c96a182f-48dd-47c5-832f-695030dc03b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1237 microversion: 2.1 time: 0.125550 Aug 12 12:21:26.762679 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 183/384] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:26 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1237 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:26.764727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1260619261", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "networks": [{"uuid": "2026b3cc-8e9b-4233-a93b-1d2daaa79b74"}]}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:26.820782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] validate_networks() for [('2026b3cc-8e9b-4233-a93b-1d2daaa79b74', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:21:27.181998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:21:27.182490 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:21:27.183079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:21:27.183553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:21:27.184057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:21:27.193702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:27.195958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:27.195958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:27.195958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:27.196296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:27.196936 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:27.214888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Getting quotas for project 8164da757959471cbbfb3b51af1edebd. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:21:27.218769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Getting quotas for user 011f5d15687d4a55ac595c8f067d6f1d and project 8164da757959471cbbfb3b51af1edebd. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:21:27.231135 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:21:27.233302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:21:27.412224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9e0157a4-464f-410d-8da8-d975c7960c1a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651396 Aug 12 12:21:27.413097 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 202/385] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:21:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 12:21:27.425331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7475c3d4-ccab-407f-bbb5-b12d65d62b93 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:27.425993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7475c3d4-ccab-407f-bbb5-b12d65d62b93 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:27.483279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7475c3d4-ccab-407f-bbb5-b12d65d62b93 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:27.493229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7475c3d4-ccab-407f-bbb5-b12d65d62b93 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1214 microversion: 2.1 time: 0.073484 Aug 12 12:21:27.494020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 184/386] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:27 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:27.655684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:27.656307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:27.664357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:27.664873 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:27.665305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:27.665997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:27.666445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:27.666865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:27.742075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:27.742788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:27.753678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:27.754607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:27.761098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:27.761098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:27.761098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:27.761098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:27.838621 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:27.845508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:27.847553 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13612b93-2c1d-4dc0-a228-fe4d42e3b649 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1222 microversion: 2.1 time: 0.110559 Aug 12 12:21:27.848209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 185/387] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:27 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:27.852759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:27.853457 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:27.859733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:27.861069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:27.861851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:27.862623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:27.863148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:27.863632 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:27.870516 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1fac746a-8201-47f2-9e8f-3ee551f96bc0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.218873 Aug 12 12:21:27.871089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 203/388] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:27 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:27.940816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:27.948384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-95ca5ef6-a7f4-4c1b-8958-c1f8c36a9dee tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1241 microversion: 2.1 time: 0.099097 Aug 12 12:21:27.948975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 186/389] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:27 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:28.515923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:28.516932 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:28.522981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:28.523454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:28.523884 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:28.524573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:28.525043 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:28.525459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:28.590067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:28.598632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-25290232-9e06-4d7a-b8d3-b3f1fa73feef tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1218 microversion: 2.1 time: 0.087959 Aug 12 12:21:28.599192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 204/390] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:28 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:28.869445 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:28.869965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:28.876410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:28.876909 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:28.877337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:28.878011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:28.878452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:28.878865 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:28.896736 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:28.897994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:28.903849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:28.904328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:28.904792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:28.905469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:28.905915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:28.906330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:28.941719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:28.949156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fe6a08fa-f666-4921-b5c6-5923f87ea2a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1270 microversion: 2.1 time: 0.083574 Aug 12 12:21:28.949721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 187/391] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:28 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:28.970191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:28.970827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:28.976914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:28.977404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:28.977887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:28.978586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:28.979044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:28.979472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:29.049020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:29.056286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-18ab4cf8-0631-4056-9a95-05ad342eede1 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1289 microversion: 2.1 time: 0.090635 Aug 12 12:21:29.056881 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 188/392] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:28 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:29.070578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:29.078334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1c7323f4-0433-4944-bf76-dc103a592813 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.186971 Aug 12 12:21:29.079409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 205/393] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:28 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:29.619656 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:29.620446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:29.627176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:29.627742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:29.628239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:29.629133 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:29.629702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:29.630351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:29.634569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:29.714845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:29.722614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13eb7141-7be6-4d0a-8480-4ee5fb0fba58 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1266 microversion: 2.1 time: 0.107018 Aug 12 12:21:29.723186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 189/394] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:29 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:29.971117 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:29.971857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:29.978384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:29.979082 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:29.979660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:29.980433 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:29.980973 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:29.981575 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:30.048245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:30.056463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d47f2df7-26bc-4d3d-b17d-84b3374353d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1276 microversion: 2.1 time: 0.089807 Aug 12 12:21:30.057378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 206/395] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:29 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:30.081627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:30.082334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:30.089417 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:30.089910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:30.090378 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:30.091217 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:30.091672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:30.092158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:30.099931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:30.100805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:30.107627 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:30.108293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:30.108901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:30.109749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:30.111050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:30.111625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:30.442425 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:30.451747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6809ed3e-a238-4f90-91d6-4d98dcf9103b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1297 microversion: 2.1 time: 0.376071 Aug 12 12:21:30.466489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 190/396] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:30 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1297 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:30.603208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:30.611653 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-356078d1-94b1-403b-814b-e71a29d5e8b9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.515287 Aug 12 12:21:30.612503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 207/397] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:30 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:30.743282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:30.743996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:30.750026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:30.751129 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:30.751619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:30.752449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:30.752991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:30.753474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:30.839807 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:30.848933 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0fab54fe-bbaa-46f9-98d1-385734879b9e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1284 microversion: 2.1 time: 0.109241 Aug 12 12:21:30.850295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 191/398] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:30 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:31.077935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:31.079865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:31.086894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:31.087603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:31.088487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:31.089593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:31.090201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:31.090792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:31.331077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:31.338824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d4b2b595-dcab-4b38-8cad-7f97145d23c6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.264835 Aug 12 12:21:31.345846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 208/399] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:31 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:31.473697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:31.474873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:31.481743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:31.482226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:31.482653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:31.483551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:31.484157 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:31.484574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:31.613835 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:31.621240 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e14ba7df-cd01-4db1-b38b-faa7ae644d03 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.151789 Aug 12 12:21:31.629116 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 192/400] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:31 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:31.633334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:31.633946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:31.639898 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:31.640385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:31.640860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:31.642227 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:31.642765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:31.643191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:31.872052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:31.873067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:31.887328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:31.888178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:31.888943 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:31.890545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:31.891800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:31.892457 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:31.892868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:31.911043 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4324313c-7a6e-46bb-a8d1-26f112971b98 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.281677 Aug 12 12:21:31.926772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 209/401] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:31 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:32.087221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:32.094913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3b2419f5-e910-44f4-9598-87d8e26c96d1 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.227498 Aug 12 12:21:32.095476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 193/402] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:31 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:32.119695 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-46d7fe8f-f961-402b-bafe-e763f301ebd0 req-4ff21f8c-72a3-40f7-ae12-876dc832c4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f381d7-b452-42ba-a0f0-1b4b74c3e07a", "tag": "6c4badc5-44f5-4d36-830c-0a3fb6d17014"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:32.131675 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-46d7fe8f-f961-402b-bafe-e763f301ebd0 req-4ff21f8c-72a3-40f7-ae12-876dc832c4f9 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:32.132299 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-46d7fe8f-f961-402b-bafe-e763f301ebd0 req-4ff21f8c-72a3-40f7-ae12-876dc832c4f9 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:32.132853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-46d7fe8f-f961-402b-bafe-e763f301ebd0 req-4ff21f8c-72a3-40f7-ae12-876dc832c4f9 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:32.153218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-46d7fe8f-f961-402b-bafe-e763f301ebd0 req-4ff21f8c-72a3-40f7-ae12-876dc832c4f9 service nova] Creating event network-changed:6c4badc5-44f5-4d36-830c-0a3fb6d17014 for instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a on hv-cinder-79797 Aug 12 12:21:32.153218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-46d7fe8f-f961-402b-bafe-e763f301ebd0 req-4ff21f8c-72a3-40f7-ae12-876dc832c4f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036297 Aug 12 12:21:32.153218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 210/403] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:21:32.209926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-765380d4-4a65-410d-9718-d7f7abbb888a req-cec9b029-d0b2-45b7-878c-0071ed480247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc24be1-99ef-4bc5-8083-14917b3bb1cb", "tag": "e566ff8f-b7d6-4402-a62d-6bc8bf9e6eb1"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:32.220938 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-765380d4-4a65-410d-9718-d7f7abbb888a req-cec9b029-d0b2-45b7-878c-0071ed480247 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:32.221423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-765380d4-4a65-410d-9718-d7f7abbb888a req-cec9b029-d0b2-45b7-878c-0071ed480247 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:32.221887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-765380d4-4a65-410d-9718-d7f7abbb888a req-cec9b029-d0b2-45b7-878c-0071ed480247 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:32.233182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-765380d4-4a65-410d-9718-d7f7abbb888a req-cec9b029-d0b2-45b7-878c-0071ed480247 service nova] Creating event network-changed:e566ff8f-b7d6-4402-a62d-6bc8bf9e6eb1 for instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb on hv-cinder-79797 Aug 12 12:21:32.238892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-765380d4-4a65-410d-9718-d7f7abbb888a req-cec9b029-d0b2-45b7-878c-0071ed480247 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032564 Aug 12 12:21:32.239699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 194/404] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:21:32.362693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:32.363392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:32.372493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:32.372993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:32.373851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:32.374555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:32.375005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:32.375421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:32.652279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:32.653055 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:32.662010 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:32.662502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:32.663032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:32.664481 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:32.664992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:32.665479 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:32.847090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:32.854997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-58c10d95-c50f-4fc2-9bbf-6b165c7b7b1b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.497338 Aug 12 12:21:32.855760 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 211/405] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:32 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:32.934907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:32.935652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:32.943004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:32.943533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:32.943967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:32.944728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:32.945167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:32.945594 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:33.302629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:33.312756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-32c9adfe-3ed6-4759-ad20-24bf60fea43d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.666748 Aug 12 12:21:33.313943 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 195/406] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:32 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:33.321306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:33.322756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:33.331932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:33.332787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:33.333433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:33.334127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:33.334579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:33.334994 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:33.381510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:33.391358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-308fe041-da52-4aa0-9f63-366dbaf09642 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.461185 Aug 12 12:21:33.391970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 212/407] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:32 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:33.584689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:33.591281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-24e51d9d-2d00-4227-9fb4-2ad7702c1000 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.276130 Aug 12 12:21:33.591845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 196/408] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:33 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:33.877266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:33.877878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:33.883694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:33.884178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:33.884587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:33.885333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:33.885783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:33.886203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:34.018109 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:34.025594 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bb5721d5-ae26-4231-a35e-17ae0b5ef7c0 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.152419 Aug 12 12:21:34.026152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 213/409] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:33 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:34.272177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-f3d01822-fbe9-485d-bcb7-1422fada6686 req-cb48ad6d-ea42-413c-bf7c-ffaeeec9e3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a850f119-f584-47aa-b111-e155bcfcbdb2", "tag": "87ca618f-8ac2-40ab-8a30-1977f61fbad0"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:34.282100 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f3d01822-fbe9-485d-bcb7-1422fada6686 req-cb48ad6d-ea42-413c-bf7c-ffaeeec9e3c5 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:34.282574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f3d01822-fbe9-485d-bcb7-1422fada6686 req-cb48ad6d-ea42-413c-bf7c-ffaeeec9e3c5 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:34.282999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f3d01822-fbe9-485d-bcb7-1422fada6686 req-cb48ad6d-ea42-413c-bf7c-ffaeeec9e3c5 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:34.293897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-f3d01822-fbe9-485d-bcb7-1422fada6686 req-cb48ad6d-ea42-413c-bf7c-ffaeeec9e3c5 service nova] Creating event network-changed:87ca618f-8ac2-40ab-8a30-1977f61fbad0 for instance a850f119-f584-47aa-b111-e155bcfcbdb2 on hv-cinder-79797 Aug 12 12:21:34.299304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-f3d01822-fbe9-485d-bcb7-1422fada6686 req-cb48ad6d-ea42-413c-bf7c-ffaeeec9e3c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030760 Aug 12 12:21:34.299873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 197/410] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:21:34.334099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:34.334641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:34.340569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:34.341088 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:34.341519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:34.342194 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:34.342641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:34.343060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:34.413690 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:34.414376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:34.420417 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:34.420938 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:34.421365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:34.422088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:34.423145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:34.423561 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:34.480735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:34.489130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3152504a-669e-4520-9298-3322e65737b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.158902 Aug 12 12:21:34.489964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 214/411] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:34 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:34.566930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:34.574628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7a5a4211-8c63-4d8d-a5c5-63a7ce9617f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.165347 Aug 12 12:21:34.575226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 198/412] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:34 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:34.612626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:34.613280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:34.619701 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:34.620278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:34.620750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:34.621434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:34.621884 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:34.622306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:34.748659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:34.756153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-66c27320-efa9-4f02-b364-b6ceef011045 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.148315 Aug 12 12:21:34.756737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 215/413] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:34 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:35.046705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:35.047353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:35.053261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:35.053735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:35.054189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:35.054861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:35.055302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:35.055718 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:35.186321 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:35.194248 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8c83a268-7517-4345-b20b-e5ccebe715df tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.151357 Aug 12 12:21:35.194797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 199/414] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:35 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:35.509450 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:35.509961 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:35.516716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:35.517203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:35.517633 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:35.518307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:35.518753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:35.519170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:35.596104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:35.596486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:35.603803 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:35.604285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:35.604751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:35.605439 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:35.605899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:35.606323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:35.657820 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:35.665406 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-71d6512b-4813-42ae-b641-e43efb9f5c19 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.159849 Aug 12 12:21:35.665970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 216/415] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:35 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:35.739280 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:35.746636 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3477ce9e-1b6d-4e12-8e8b-4366d58b50f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.154941 Aug 12 12:21:35.747204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 200/416] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:35 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:35.776285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:35.776847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:35.782904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:35.783379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:35.783813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:35.784767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:35.785217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:35.785640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:35.915036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:35.923235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-510a36c9-4723-4136-bd10-a115508136cf tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.150834 Aug 12 12:21:35.923802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 217/417] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:35 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:36.215354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:36.215963 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:36.222541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:36.223294 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:36.223647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:36.236215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:36.236215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:36.236215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:36.280884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:36.353890 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:36.361635 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b1a3f0cb-50fb-4305-8a0e-6670e735f1f2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.150165 Aug 12 12:21:36.362201 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 201/418] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:36 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:36.686870 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:36.688034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:36.693987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:36.694461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:36.695911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:36.695911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:36.696166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:36.696371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:36.767973 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:36.768575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:36.774901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:36.775384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:36.775859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:36.776544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:36.777019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:36.787103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:36.838474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:36.842050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:36.846940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-340a0551-6f92-4931-ab51-509d57fad624 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.163898 Aug 12 12:21:36.847602 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 218/419] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:36 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:36.919797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:36.928128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e4255d9f-ca71-4c5b-a59e-3cc67cd2e029 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.164793 Aug 12 12:21:36.928716 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 202/420] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:36 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:36.943760 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:36.944303 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:36.950344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:36.950820 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:36.951252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:36.951928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:36.952376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:36.952834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:37.081134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:37.088519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-938639f7-d151-48ef-bf69-ffc67c021573 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.148988 Aug 12 12:21:37.089117 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 219/421] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:36 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:37.382429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:37.383081 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:37.388989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:37.389468 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:37.389901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:37.391112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:37.391666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:37.391979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:37.489781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=10 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:37.524371 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:37.532302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8a995501-b364-4e63-8ce2-3d40f47efc92 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.153765 Aug 12 12:21:37.532895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 203/422] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:37 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:37.867256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:37.867858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:37.869766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=4 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:37.870447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=18 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:37.875802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:37.876278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:37.876731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:37.877406 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:37.877848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:37.878279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:37.949763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:37.950429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:37.957258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:37.957746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:37.958209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:37.958985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:37.959465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:37.959882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:38.034753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:38.042275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-05c53790-6e68-4089-9043-79ee370cb126 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.178792 Aug 12 12:21:38.042852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 220/423] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:37 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:38.106808 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:38.110690 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:38.116700 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:38.116817 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ff5eeef8-1549-4d08-b3e6-98a79de2d079 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.168993 Aug 12 12:21:38.116817 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 204/424] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:37 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:38.118575 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:38.119122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:38.119623 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:38.120378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:38.120933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:38.121449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:38.377002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:38.384864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e9ac1a37-7219-4ba0-91e9-588c94ad34e3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.278781 Aug 12 12:21:38.391492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 221/425] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:38 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:38.553879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:38.554539 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:38.560442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:38.560961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:38.561433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:38.562105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:38.562554 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:38.563828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:38.774700 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:38.782346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-28242725-4608-43bc-b2a7-e822ec74807b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.232674 Aug 12 12:21:38.782915 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 205/426] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:38 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:39.065769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:39.066307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:39.072231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:39.072751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:39.073181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:39.073860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:39.074306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:39.074726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:39.135611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:39.136251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:39.142367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:39.142839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:39.143447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:39.144133 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:39.144579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:39.145020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:39.234209 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:39.242578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5c40df0d-f854-4e79-8569-fa38afaa2678 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.180789 Aug 12 12:21:39.243147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 222/427] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:39 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:39.290287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:39.297911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d4b835c0-35e9-4fc6-b42f-87ab132eb54f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.165977 Aug 12 12:21:39.298478 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 206/428] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:39 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:39.406203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:39.407516 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:39.413705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:39.414177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:39.414602 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:39.415280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:39.415717 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:39.416128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:39.546529 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:39.554067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2608ad83-08e0-410f-9dca-3024b61530a4 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.151693 Aug 12 12:21:39.554626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 223/429] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:39 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:39.803402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:39.804446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:39.810449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:39.811198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:39.811342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:39.812017 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:39.812462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:39.813775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:39.817731 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:39.938928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:39.946319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-96f2bf49-de32-45ed-99e2-a052e282c060 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.146780 Aug 12 12:21:39.946935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 207/430] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:39 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:40.263366 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:40.264002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:40.270098 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.270597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.271034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:40.271714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.272163 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.272581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:40.318332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:40.319048 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:40.325353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.325848 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.326259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:40.326931 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.327374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.327798 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:40.444616 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:40.452850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-935bec65-88af-436c-bcf0-6f3c14c7f9fc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.193057 Aug 12 12:21:40.465239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 224/431] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:40 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:40.490036 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:40.497822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c5d78e0b-fac6-4fdc-8f88-e2bcb9c8819f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.183277 Aug 12 12:21:40.498382 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 208/432] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:40 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:40.612515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-657a306c-f079-4a6b-933c-51ae98012dcb req-92426070-f1c2-4322-b276-f1bb33ff390f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc24be1-99ef-4bc5-8083-14917b3bb1cb", "name": "network-vif-plugged", "status": "completed", "tag": "e566ff8f-b7d6-4402-a62d-6bc8bf9e6eb1"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:40.621871 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-657a306c-f079-4a6b-933c-51ae98012dcb req-92426070-f1c2-4322-b276-f1bb33ff390f service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.622341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-657a306c-f079-4a6b-933c-51ae98012dcb req-92426070-f1c2-4322-b276-f1bb33ff390f service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.622761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-657a306c-f079-4a6b-933c-51ae98012dcb req-92426070-f1c2-4322-b276-f1bb33ff390f service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:40.630976 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:40.631674 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:40.634341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-657a306c-f079-4a6b-933c-51ae98012dcb req-92426070-f1c2-4322-b276-f1bb33ff390f service nova] Creating event network-vif-plugged:e566ff8f-b7d6-4402-a62d-6bc8bf9e6eb1 for instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb on hv-cinder-79797 Aug 12 12:21:40.637633 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.641925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.641925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:40.641925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.642324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-657a306c-f079-4a6b-933c-51ae98012dcb req-92426070-f1c2-4322-b276-f1bb33ff390f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031500 Aug 12 12:21:40.642521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.642521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:40.642667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 225/433] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:21:40.769185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:40.776880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-101e18cb-aafd-4e22-8332-256d751596b9 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.149721 Aug 12 12:21:40.777448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 209/434] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:40 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:40.968020 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:40.968742 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:40.975624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.976093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.976517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:40.977226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:40.977671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:40.978084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:41.105869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:41.113555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bfb3270d-1653-4831-ae2b-b59ae41f57a2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.149659 Aug 12 12:21:41.114127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 226/435] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:40 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:41.486688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:41.487400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:41.493879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:41.494363 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:41.494802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:41.495485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:41.495939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:41.496370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:41.518618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:41.519214 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:41.525330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:41.525808 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:41.526234 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:41.526936 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:41.527377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:41.527984 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:41.696062 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:41.702886 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:41.703358 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-aad4958a-9f4a-44c8-bbfe-574428f3a44d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.221424 Aug 12 12:21:41.704103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 210/436] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:41 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:41.710968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a72f0cbe-30a7-4bd3-a3a5-991a1006ad01 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.196345 Aug 12 12:21:41.711532 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 227/437] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:41 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:41.798954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:41.799470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:41.805503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:41.805979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:41.806403 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:41.807113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:41.807559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:41.807976 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:41.934854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:41.942251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a02aa6ff-b903-4197-a373-6c510f37a890 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.147714 Aug 12 12:21:41.942808 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 211/438] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:41 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:42.134745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:42.135273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:42.141266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:42.141748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:42.142188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:42.142863 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:42.143313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:42.143736 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:42.272187 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:42.279907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8dc62faa-6579-479c-a3db-8d91946a3a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.149078 Aug 12 12:21:42.280509 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 228/439] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:42 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:42.724914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:42.725539 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:42.731755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:42.732212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:42.732942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:42.732942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:42.733236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:42.733715 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:42.733883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:42.734311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:42.739796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:42.745630 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:42.745630 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:42.745630 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:42.745630 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:42.746093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:42.921452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:42.929620 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:42.930083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a79dea1d-a2e9-4d63-9d0c-3eb87541dfd7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.209557 Aug 12 12:21:42.930661 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 212/440] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:42 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:42.937061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e5298161-8760-43e7-89fa-2ac7903dd278 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.208525 Aug 12 12:21:42.937625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 229/441] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:42 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:42.962302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:42.962906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:42.968790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:42.969767 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:42.970199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:42.970878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:42.971329 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:42.971750 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:43.100133 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:43.107459 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-063e8292-b562-46fd-96b7-965049af3237 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.148830 Aug 12 12:21:43.108026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 213/442] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:42 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:43.301354 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:43.301963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:43.307859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:43.308371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:43.308848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:43.309534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:43.309987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:43.310417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:43.436984 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:43.445026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1d9e13c1-0633-446c-aac3-19c515960511 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.147509 Aug 12 12:21:43.445597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 230/443] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:43 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:43.950339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:43.950950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:43.957724 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:43.957937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:43.958367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:43.958563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:43.958720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:43.959306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:43.959767 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:43.960195 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:43.964319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:43.964825 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:43.965251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:43.965926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:43.966367 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:43.966784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:44.147198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:44.154725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3884d304-10ad-48a2-9e16-390741e8d5f8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.208252 Aug 12 12:21:44.168111 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 214/444] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:43 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:44.169045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:44.169186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:44.169186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:44.169329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0b188269-e31b-4d42-bd1f-6e4f256f2933 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.212789 Aug 12 12:21:44.169329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 231/445] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:43 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:44.169490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:44.169490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:44.169490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:44.169490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:44.169771 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:44.170178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:44.302890 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:44.310272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d26fdff1-9cf6-4733-940d-3e051433b656 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.154041 Aug 12 12:21:44.310828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 215/446] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:44 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:44.466062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:44.466715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:44.473740 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:44.474377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:44.474835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:44.475688 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:44.476133 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:44.476880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:44.605555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:44.613025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4ccbaedb-3588-4c67-8fef-019fa8fed3b2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.151110 Aug 12 12:21:44.613651 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 232/447] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:44 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:45.184907 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:45.185516 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:45.188618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:45.189258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:45.192953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:45.197794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:45.197794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:45.197794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:45.197794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:45.198126 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:45.198126 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:45.198293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:45.198370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:45.198370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:45.198370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:45.198370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:45.391959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:45.394478 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:45.400276 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-50b76956-0c2c-4bfe-a7ae-1fa7553f906d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.219360 Aug 12 12:21:45.400887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 216/448] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:45 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:45.402150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-32753a46-98f7-41b2-8968-9241f2e4977d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.217854 Aug 12 12:21:45.405867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:45.409426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:45.414528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:45.414790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 233/449] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:45 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:45.415428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:45.415879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:45.416746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:45.417204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:45.417801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:45.553642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:45.561339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-889e858d-b105-4820-a191-3c50818c8e17 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.159097 Aug 12 12:21:45.561967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 217/450] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:45 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:45.633803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:45.634409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:45.636543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:45.641481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:45.641965 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:45.642395 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:45.643070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:45.643517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:45.643935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:45.775787 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:45.784279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1e2641e6-cecb-4c52-802a-1dcb422c82a5 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.154229 Aug 12 12:21:45.784902 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 234/451] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:45 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:46.421239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:46.421847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:46.424107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:46.425386 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:46.429362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.430119 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.430383 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:46.430974 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.431427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.431856 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:46.433936 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.438499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.438499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:46.438499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.438499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.439369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:46.637598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:46.641782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:46.649765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-02db7c11-9d7e-4a10-a359-8cc3a3faec47 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.230217 Aug 12 12:21:46.650607 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 235/452] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:46 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:46.652419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ac524080-419f-41ab-ba90-4c8a11676e23 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.234648 Aug 12 12:21:46.653929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 218/453] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:46 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:46.655834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:46.656544 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:46.663379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.664035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.669805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:46.669805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.669805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.669805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:46.670877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:46.805560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:46.806579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:46.814639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.815496 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.816078 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:46.817262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.819014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.819014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:46.856182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:46.866675 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-32ed8c7b-5a15-49eb-bde8-81c59bdb257c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.214803 Aug 12 12:21:46.869764 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 236/454] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:46 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:46.976537 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-6ec9efac-473c-4838-9338-07dadc3875f8 req-da617c57-6904-420b-b5f4-7bea6adef594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f381d7-b452-42ba-a0f0-1b4b74c3e07a", "name": "network-vif-plugged", "status": "completed", "tag": "6c4badc5-44f5-4d36-830c-0a3fb6d17014"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:46.987977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-6ec9efac-473c-4838-9338-07dadc3875f8 req-da617c57-6904-420b-b5f4-7bea6adef594 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:46.989273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-6ec9efac-473c-4838-9338-07dadc3875f8 req-da617c57-6904-420b-b5f4-7bea6adef594 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:46.989273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-6ec9efac-473c-4838-9338-07dadc3875f8 req-da617c57-6904-420b-b5f4-7bea6adef594 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:47.000793 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-6ec9efac-473c-4838-9338-07dadc3875f8 req-da617c57-6904-420b-b5f4-7bea6adef594 service nova] Creating event network-vif-plugged:6c4badc5-44f5-4d36-830c-0a3fb6d17014 for instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a on hv-cinder-79797 Aug 12 12:21:47.006512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-6ec9efac-473c-4838-9338-07dadc3875f8 req-da617c57-6904-420b-b5f4-7bea6adef594 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033584 Aug 12 12:21:47.007518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 237/455] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:21:47.015209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:47.023195 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-60dae75e-c6f4-4de9-b2a1-8919d149d22f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.222589 Aug 12 12:21:47.024106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 219/456] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:46 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:47.671739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:47.677596 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:47.678199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:47.682249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:47.685821 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:47.686366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:47.686803 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:47.687720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:47.688038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:47.688284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:47.689211 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:47.689949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:47.690366 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:47.691048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:47.691493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:47.692349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:47.898250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:47.902597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:47.906365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-50340b94-fb89-4dcc-ad6d-1856265f8734 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.238684 Aug 12 12:21:47.907674 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 238/457] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:47 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:47.915435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:47.916831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:47.923712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:47.923861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-679bdf4e-64c0-4c3e-b83b-6c7d01bb4b74 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.244633 Aug 12 12:21:47.926065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 220/458] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:47 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:47.933089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:47.935213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:47.936340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:47.937028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:47.938167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:48.044261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:48.044906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:48.051593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:48.052077 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:48.054278 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:48.054278 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:48.054278 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:48.054278 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:48.071910 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:48.080318 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c34e182b-5150-4c37-85fe-b873879af5da tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.171384 Aug 12 12:21:48.081050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 239/459] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:47 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:48.218560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:48.227324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f55f6713-5fdb-4ba1-9fdf-d2ffa57cab5d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1318 microversion: 2.1 time: 0.186874 Aug 12 12:21:48.227911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 221/460] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:48 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:48.935795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:48.936671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:48.945238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:48.945947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:48.946051 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:48.946565 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:48.947085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:48.947884 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:48.948393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:48.948950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:48.953259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:48.953779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:48.954964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:48.955760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:48.956578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:48.956898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:49.374988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:49.383576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0a19f1aa-6b8a-4063-99de-818ed6fcc9ad tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.452046 Aug 12 12:21:49.384461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 240/461] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:48 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:49.389362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:49.390280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:49.398434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:49.403840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:49.404328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:49.404804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:49.405496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:49.405945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:49.406366 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:49.407751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eb69a44b-be8e-4352-9458-f23747a739e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.465634 Aug 12 12:21:49.417241 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 222/462] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:48 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:49.425046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:49.425907 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:49.430034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:49.433777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:49.434482 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:49.435112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:49.435943 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:49.436578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:49.437084 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:49.608161 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:49.612290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:49.617868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:49.617981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d12472f3-1f0a-4cd1-aade-0e77ec1b2928 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.230427 Aug 12 12:21:49.617981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 241/463] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:49 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:49.620562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-31278b3c-f0ea-43b0-9d90-6a997f4a734b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1506 microversion: 2.1 time: 0.201125 Aug 12 12:21:49.621145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 223/464] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:49 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:50.403868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:50.404472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:50.410723 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:50.411201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:50.411632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:50.412307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:50.412786 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:50.413210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:50.430365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:50.430967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:50.439215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:50.439704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:50.440134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:50.440942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:50.441370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:50.441790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:50.612969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:50.620373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:50.620747 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-eb86da7a-aee0-4964-a164-7c399182d25a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.220655 Aug 12 12:21:50.621410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 242/465] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:50 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:50.627814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b7c19719-b87d-466d-9509-61098b1b9255 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.201866 Aug 12 12:21:50.628359 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 224/466] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:50 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:50.642224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:50.642224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:50.644509 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:50.645029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:50.645459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:50.646137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:50.646587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:50.647005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:50.777508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:50.786339 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9643dbf5-252c-45ea-a4d2-b570e8620fcd tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.152339 Aug 12 12:21:50.786904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 243/467] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:50 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:51.144125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-916556244", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:51.196952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] validate_networks() for None {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:21:51.482909 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:21:51.483520 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:21:51.483926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:21:51.484330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:21:51.485265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:21:51.495034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:51.495510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:51.495940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:51.496697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:51.497147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:51.497565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:51.515069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Getting quotas for project 58a76d86371c448a8ff0596da2235ba5. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:21:51.519821 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Getting quotas for user 013b2068b6e8422781a93b4ecef436bc and project 58a76d86371c448a8ff0596da2235ba5. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:21:51.530728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:21:51.533843 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:21:51.643358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:51.643907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:51.650013 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:51.650508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:51.652014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:51.652014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:51.652261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:51.652611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:51.662970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8207da62-425a-4646-8dbf-77cf0a406e18 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523354 Aug 12 12:21:51.669471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 225/468] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:21:51.669471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:51.669471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:51.675579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:51.676007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:51.680772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:51.680772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:51.680772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:51.680772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:51.861752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:51.869624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6f72712f-9808-4d00-aabe-36fec57f3a1c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.231560 Aug 12 12:21:51.870275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 244/469] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:51 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:51.876216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c013dc2b-9410-48bd-bd56-89763d053f56 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:51.877034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c013dc2b-9410-48bd-bd56-89763d053f56 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:51.877205 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:51.885380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f27412c7-bfd9-4e5c-abb1-188eac71d964 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.220532 Aug 12 12:21:51.886093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 226/470] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:51 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:51.890624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:51.891816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:51.898652 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:51.899079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:51.899508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:51.900190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:51.900647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:51.901075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:51.950348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c013dc2b-9410-48bd-bd56-89763d053f56 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:51.958735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c013dc2b-9410-48bd-bd56-89763d053f56 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1214 microversion: 2.1 time: 0.087250 Aug 12 12:21:51.959312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 245/471] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:51 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:52.049170 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:52.056916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-150a2c3b-23ac-462c-819f-4b8449cb7284 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.169745 Aug 12 12:21:52.057493 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 227/472] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:51 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:52.893185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:52.893957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:52.900630 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:52.901167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:52.901803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:52.902518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:52.902975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:52.903430 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:52.906668 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:52.908174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:52.915803 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:52.916324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:52.916985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:52.917828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:52.918424 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:52.919127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.120919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:53.128003 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:53.129765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f9093bd4-71ac-4f27-8288-5665b57f1c23 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1500 microversion: 2.1 time: 0.241955 Aug 12 12:21:53.130338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 246/473] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:52 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1500 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:53.134839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:53.135430 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:53.135563 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ae287eb2-49a5-442c-b901-5b19dcd0a983 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.232915 Aug 12 12:21:53.136025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 228/474] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:52 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:53.140705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:53.141521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:53.142341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.143523 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.143955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.144708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.145154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.145577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.150655 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.151334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.151762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.152452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.152932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.153355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.221187 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:53.229493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b684060d-0f8d-48e9-aa5b-021be95206b1 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.098077 Aug 12 12:21:53.232619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 247/475] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:53 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:53.243404 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6523a091-b88c-4ab8-8c2a-f771f440a9e9"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:53.247912 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:53.256037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.256527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.260950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.260950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.260950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.260950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.286583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] HTTP exception thrown: Cannot 'attach_volume' instance 2e3556b5-b492-4712-ae79-c1cfea75596f while it is in vm_state rescued Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Request method failure captured: Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: POST /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f/os-volume_attachments HTTP/1.1 Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 74 Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU1XxsYk5VN_T93GFCyU7RYD5hJ0BUvCvlf_XfH6CNe7so5BnwxxiAMNAPR3AFdodLdusZpG2dRuzFwRh-WoYlJ9uzjtmndJ9XnlnxpvjQSOcEwevrL5RQryb0o3Z3JjmOG4-zKB_4aZsdhzluBi1_8emtWcCSYZ8JlpKE6IFVAs9c Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:21:53.288389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e8def85acdd4e308bb51b4063c2ab4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}] Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 099b87a6c6b8409ab188c0b71ded7f55 Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {"volumeAttachment": {"volumeId": "6523a091-b88c-4ab8-8c2a-f771f440a9e9"}} Aug 12 12:21:53.290735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Cannot 'attach_volume' instance 2e3556b5-b492-4712-ae79-c1cfea75596f while it is in vm_state rescued Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'server_id': '2e3556b5-b492-4712-ae79-c1cfea75596f', 'body': {'volumeAttachment': {'volumeId': '6523a091-b88c-4ab8-8c2a-f771f440a9e9'}}} Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e3556b5-b492-4712-ae79-c1cfea75596f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:21:53.295198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2e3556b5-b492-4712-ae79-c1cfea75596f while it is in vm_state rescued Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:21:53.296569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:21:53.298424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:21:53.298424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:21:53.298424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2e3556b5-b492-4712-ae79-c1cfea75596f while it is in vm_state rescued Aug 12 12:21:53.298424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:21:53.298424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Returning 409 to user: Cannot 'attach_volume' instance 2e3556b5-b492-4712-ae79-c1cfea75596f while it is in vm_state rescued {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:21:53.298424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4022cbea-5333-4d6c-83cc-9868a60b4f09 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058965 Aug 12 12:21:53.298424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 248/476] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:21:53 2022] POST /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 12 12:21:53.301451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:21:53.301978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:53.307872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.308348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.308836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.309524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.309968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.310381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.320444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:53.331007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e3aed654-b7c4-407c-8bdb-5818a5938be7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.190857 Aug 12 12:21:53.331640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 229/477] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:53 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:53.565929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-52e64ad9-a45e-4fd6-b49f-deff83ceaf2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f/action" status: 202 len: 0 microversion: 2.1 time: 0.269023 Aug 12 12:21:53.566561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 249/478] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:21:53 2022] POST /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:21:53.574846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:53.575482 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:53.581569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.582032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.582472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.583158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:53.583609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:53.584030 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:53.723019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:53.730525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ad4a909e-bd3c-4269-8b09-06d8b1676f7c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.159565 Aug 12 12:21:53.731215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 230/479] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:53 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:54.158531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:54.159364 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:54.165476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:54.165949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:54.166376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:54.167046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:54.167485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:54.167899 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:54.250702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:54.251324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:54.257985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:54.258465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:54.258899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:54.259615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:54.260072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:54.260495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:54.307097 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:54.315104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-79fb0520-7e1c-429b-a873-3f2617eb44f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.161633 Aug 12 12:21:54.315673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 250/480] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:54 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:54.322448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:54.330310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-343d07ff-8278-4bf4-9837-034e5f3e9911 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.083534 Aug 12 12:21:54.330863 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 231/481] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:54 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:54.352606 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:54.353236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:54.359383 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:54.359864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:54.360305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:54.361017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:54.361470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:54.361893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:54.494095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:54.501644 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-30a2d6ef-ef5b-4a33-9ddc-f5ab4f49ff0d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.152848 Aug 12 12:21:54.502471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 251/482] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:54 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:54.753470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:54.753997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:54.759814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:54.760289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:54.760744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:54.761412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:54.761859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:54.762273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:54.888395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:54.896518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-05ccf1bf-3555-4ef2-943c-cbabc2399d43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.147533 Aug 12 12:21:54.897262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 232/483] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:54 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:55.335822 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:55.336418 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:55.342416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:55.342887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:55.343315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:55.344205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:55.344678 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:55.345096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:55.351034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:55.352224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:55.358851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:55.359334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:55.360490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:55.361319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:55.361779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:55.362206 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:55.443208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:55.450723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-42e761eb-b14e-4cdc-942d-b1a962ea7b23 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.103938 Aug 12 12:21:55.451290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 233/484] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:55 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:55.499545 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:55.508052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d9d5733b-349b-4c8a-88e8-ec3613f64907 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.176022 Aug 12 12:21:55.508684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 252/485] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:55 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:55.522546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:55.523166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:55.534536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:55.534536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:55.534536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:55.534536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:55.534930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:55.534930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:55.664222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:55.671951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b288d0f9-573a-47b3-81fd-6050f0de99b7 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.153305 Aug 12 12:21:55.673137 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 234/486] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:55 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:55.917014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:55.917613 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:55.923799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:55.924315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:55.924777 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:55.925567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:55.926016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:55.926436 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:56.059378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:56.063077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:56.067363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8d5854d8-8e27-4d55-bbe7-2ff1c69728a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.154173 Aug 12 12:21:56.067924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 253/487] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:55 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:56.471615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:56.472372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:56.479130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:56.479609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:56.480041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:56.480755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:56.481204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:56.481628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:56.529663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:56.530262 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:56.537065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:56.537657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:56.538096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:56.538770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:56.539212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:56.539681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:56.542964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:56.551127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ecacd799-ebde-4006-86e1-eac4f3648e68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.083570 Aug 12 12:21:56.551696 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 235/488] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:56 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:56.673988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:56.681245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-585f188d-3d17-40c8-9cd7-809eaeb1b131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.155786 Aug 12 12:21:56.681800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 254/489] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:56 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:21:56.693572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:56.694283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:56.700519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:56.701076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:56.701582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:56.702289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:56.702743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:56.703168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:56.832942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:56.840194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-640a907e-e75e-4196-8d5c-065dc6149d9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.150576 Aug 12 12:21:56.840765 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 236/490] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:56 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:57.089087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:57.089625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:57.096233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:57.096747 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:57.097186 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:57.097868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:57.098327 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:57.098766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:57.231063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:57.239881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f281e6bf-2947-40b2-ae3a-ca9fd9649cda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.154651 Aug 12 12:21:57.240449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 255/491] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:57 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:57.573056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:57.573659 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:57.580600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:57.581317 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:57.581756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:57.582427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:57.582874 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:57.583292 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:57.645705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:57.653724 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1476ab0d-4f3b-41b5-aa5b-916ca97b62cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.084459 Aug 12 12:21:57.654376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 237/492] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:57 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:57.702744 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:57.703472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:57.709506 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:57.709988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:57.710419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:57.711095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:57.711541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:57.711962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:57.842908 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:57.851845 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-db32ea19-d25b-40c1-b302-3355e2d98b3c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.152951 Aug 12 12:21:57.852475 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 256/493] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:57 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:57.861073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:57.861671 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:57.867581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:57.868055 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:57.868486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:57.869195 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:57.869644 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:57.870061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:57.997736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:58.005008 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d291d5ad-06e2-4fb4-9d0f-ef8035763eb8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.148282 Aug 12 12:21:58.005567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 238/494] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:57 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:58.261545 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:58.262155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:58.269518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:58.269796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:58.270260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:58.270959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:58.271417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:58.271846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:58.412364 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:58.420174 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cec10e93-f28e-4a37-8ae5-6534337b457e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.162484 Aug 12 12:21:58.420964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 257/495] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:58 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:58.675295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:58.675903 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:58.682134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:58.682670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:58.683111 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:58.688421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:58.688421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:58.688421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:58.748713 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:58.756227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8b0c5736-609a-4e4b-b864-600ad78f3731 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.085304 Aug 12 12:21:58.756806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 239/496] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:58 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:58.873533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:58.874131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:58.880033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:58.880515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:58.880966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:58.881642 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:58.882082 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:58.882497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:59.011124 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:59.019194 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-de10f00b-b3d0-4807-ae4f-e8f2a2eb6bd4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.149600 Aug 12 12:21:59.019847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 258/497] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:58 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:59.026392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:59.027073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:59.034345 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:59.034820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:59.035251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:59.035953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:59.036398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:59.036852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:59.168700 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:59.176086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0e1c4a1a-8ca4-4122-87ac-aca27935243b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.153622 Aug 12 12:21:59.176633 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 240/498] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:59 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:59.442008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:59.442642 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:59.448582 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:59.449099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:59.449533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:59.450246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:59.450718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:59.451166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:59.584203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:59.591724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-db2bcf3d-189a-4d9d-8c88-53df449f7395 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.154250 Aug 12 12:21:59.592276 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 259/499] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:59 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:21:59.776662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:21:59.777311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:21:59.783692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:59.784178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:59.784617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:59.785340 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:21:59.785796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:21:59.786226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:21:59.790136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:21:59.847966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:21:59.855204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3b8fc587-8648-4582-85bd-1d8d02ba5f69 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.082386 Aug 12 12:21:59.855761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 241/500] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:21:59 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:00.041507 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:00.042047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:00.048926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:00.049427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:00.049856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:00.050558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:00.051008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:00.051429 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:00.184097 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:00.191661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ffa4a687-cfd8-4ae8-b585-48b8424e7f26 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.154067 Aug 12 12:22:00.192489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 260/501] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:00 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:00.196955 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:00.197562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:00.204032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:00.205288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:00.205729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:00.206444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:00.206899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:00.207324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:00.337861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:00.345973 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c48f57a4-5b11-438b-8ebb-1b410a065f18 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.152816 Aug 12 12:22:00.346530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 242/502] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:00 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:00.612795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:00.613318 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:00.619279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:00.619756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:00.620186 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:00.620888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:00.621428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:00.621853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:00.753340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:00.760926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-99a19340-90d0-4e33-bbbd-d7adc1cfa8dc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.152167 Aug 12 12:22:00.761481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 261/503] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:00 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:00.876990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:00.877523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:00.883624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:00.884106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:00.884545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:00.885261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:00.885714 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:00.886141 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:00.946153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:00.953658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e46cc39b-03a3-405d-be18-df74419b5629 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.081180 Aug 12 12:22:00.954891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 243/504] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:00 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:01.212777 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:01.213407 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:01.219335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:01.219844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:01.220347 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:01.221046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:01.221498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:01.221920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:01.350146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:01.357472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9d3e4bcc-d966-4630-96a8-dc2595b33d7c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.148607 Aug 12 12:22:01.358036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 262/505] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:01 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:01.367094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:01.367700 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:01.374412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:01.374903 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:01.375342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:01.376041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:01.376811 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:01.377293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:01.505207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:01.509007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:01.516881 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9ddbc010-820f-4ced-bfce-283bbdf8ad45 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.153308 Aug 12 12:22:01.517464 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 244/506] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:01 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:01.784067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:01.784692 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:01.790541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:01.791027 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:01.791442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:01.792110 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:01.792553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:01.792995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:01.925913 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:01.933405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1ef7d2e0-dc01-4788-aa6c-084eecaf3b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.154106 Aug 12 12:22:01.933959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 263/507] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:01 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:01.977963 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:01.978640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:01.981166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:01.987972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:01.988747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:01.989388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:01.990582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:01.991240 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:01.991800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:02.053832 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:02.060975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1936c8e9-5acd-4741-9eed-9a33f40cc6f3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.089271 Aug 12 12:22:02.061530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 245/508] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:01 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:02.379931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:02.380502 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:02.382295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:02.387012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:02.387489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:02.387924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:02.388602 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:02.389148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:02.389597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:02.527135 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:02.535239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-413325e1-6242-4b94-b86f-94e2e1ea8cc9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.159799 Aug 12 12:22:02.537705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 264/509] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:02 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:02.538218 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:02.538919 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:02.545159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:02.545631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:02.546058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:02.546977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:02.547426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:02.547845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:02.685534 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:02.693798 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5079a5cc-bf95-4669-b05a-ce6ade727a88 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.159809 Aug 12 12:22:02.694366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 246/510] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:02 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:02.953636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:02.954241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:02.960476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:02.960992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:02.961427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:02.962111 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:02.962561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:02.962977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:03.081704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:03.082298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:03.088337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:03.088722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:03.089158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:03.089851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:03.090335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:03.090562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:03.090736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:03.098725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f86d4dbe-7ccc-41a0-babc-2a0e51c96a7e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.148856 Aug 12 12:22:03.099293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 265/511] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:02 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:03.150543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:03.158197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d0033cde-b0db-485f-b4fb-afbc37c0552d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.080361 Aug 12 12:22:03.159226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 247/512] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:03 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:03.556434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:03.557001 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:03.563132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:03.563614 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:03.564041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:03.564744 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:03.565803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:03.566226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:03.694697 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:03.701979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6f08ec84-381f-4853-aa80-39bf85f3abc2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.149517 Aug 12 12:22:03.702531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 266/513] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:03 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:03.714530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:03.715161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:03.721693 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:03.722215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:03.722655 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:03.723340 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:03.723862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:03.724312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:03.856888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:03.865159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0afa76d1-05a6-4b71-87f2-0e8032600c30 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.153721 Aug 12 12:22:03.865159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 248/514] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:03 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:04.119673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:04.120230 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:04.126165 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:04.126650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:04.127079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:04.128352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:04.128843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:04.129271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:04.179975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:04.180601 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:04.186854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:04.187336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:04.187766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:04.188444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:04.188919 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:04.189353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:04.258336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:04.265645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0ffd9d1b-0d0e-4f8d-9268-751aad982496 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.089496 Aug 12 12:22:04.266227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 249/515] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:04 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:04.280713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:04.288469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1091c067-86ee-4b01-8753-1d238d9040cc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.172737 Aug 12 12:22:04.289056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 267/516] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:04 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:04.723970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:04.724577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:04.731003 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:04.731489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:04.731923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:04.732609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:04.733085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:04.733509 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:04.879382 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:04.885895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:04.890901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:04.891039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f25e8e8e-6838-4044-b49f-52eb72972c13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.169583 Aug 12 12:22:04.891039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 250/517] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:04 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:04.896900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:04.897442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:04.897869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:04.898558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:04.899070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:04.899514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:05.030714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:05.038404 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9240b941-e5cc-4f50-8b72-ce560fc77cc0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.156670 Aug 12 12:22:05.039173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 268/518] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:04 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:05.287222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:05.288614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:05.295794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:05.296289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:05.296997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:05.297908 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:05.298741 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:05.299559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:05.310390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:05.310990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:05.317776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:05.319025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:05.319879 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:05.320496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:05.320981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:05.321398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:05.410711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:05.419094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5694ae59-f8d9-4f5b-b504-8812c0a9c8d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1218 microversion: 2.1 time: 0.136206 Aug 12 12:22:05.420074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 251/519] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:05 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:05.591288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:05.600869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a4df01d8-362b-4b19-9ff1-6af81c2c073b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.294297 Aug 12 12:22:05.601453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 269/520] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:05 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:05.910860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:05.911513 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:05.919945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:05.919945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:05.919945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:05.920787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:05.921479 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:05.921923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:06.059821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:06.060394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:06.069998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:06.070493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:06.070926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:06.072025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:06.072507 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:06.075008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:06.098767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:06.464889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:06.471867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:06.472939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-01c6ab71-ea61-431c-82e2-3d13e7b1f854 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.566406 Aug 12 12:22:06.473511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 252/521] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:05 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:06.480968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-604516dc-d854-4a99-a56c-85aedc217a9b tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.425189 Aug 12 12:22:06.481959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 270/522] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:06 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:06.495839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:06.496596 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:06.503462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:06.508080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:06.508080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:06.508080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:06.508080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:06.508522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:06.567811 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:06.575308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3e311d81-1475-4bf2-90de-d3a7a78fe844 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1266 microversion: 2.1 time: 0.100177 Aug 12 12:22:06.575879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 253/523] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:06 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:06.625439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:06.625968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:06.632041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:06.632531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:06.633001 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:06.633688 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:06.634137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:06.634563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:06.772246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:06.780485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e8553f55-cee0-4c7f-8925-01ea8f70241b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.158945 Aug 12 12:22:06.781125 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 271/524] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:06 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:07.463814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-b052d1c2-e7d2-4653-8ae0-23aec2404485 req-177ede6e-beed-42d4-a07a-febc763b8f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a850f119-f584-47aa-b111-e155bcfcbdb2", "name": "network-vif-plugged", "status": "completed", "tag": "87ca618f-8ac2-40ab-8a30-1977f61fbad0"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:07.475726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b052d1c2-e7d2-4653-8ae0-23aec2404485 req-177ede6e-beed-42d4-a07a-febc763b8f23 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.476320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b052d1c2-e7d2-4653-8ae0-23aec2404485 req-177ede6e-beed-42d4-a07a-febc763b8f23 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.476653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b052d1c2-e7d2-4653-8ae0-23aec2404485 req-177ede6e-beed-42d4-a07a-febc763b8f23 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.488934 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-b052d1c2-e7d2-4653-8ae0-23aec2404485 req-177ede6e-beed-42d4-a07a-febc763b8f23 service nova] Creating event network-vif-plugged:87ca618f-8ac2-40ab-8a30-1977f61fbad0 for instance a850f119-f584-47aa-b111-e155bcfcbdb2 on hv-cinder-79797 Aug 12 12:22:07.494191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-b052d1c2-e7d2-4653-8ae0-23aec2404485 req-177ede6e-beed-42d4-a07a-febc763b8f23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034739 Aug 12 12:22:07.495283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 254/525] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:07.496096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:07.496948 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:07.505089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.505753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.506201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.506723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:07.506934 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.507417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.507529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:07.507921 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.513727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.514177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.514621 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.515316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.515767 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.516192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.722292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:07.730178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-af1829be-14e6-4c78-9eb1-46e2fd2817f0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.238911 Aug 12 12:22:07.730707 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:07.730860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 272/526] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:07 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:07.735204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:07.735991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:07.739344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-41d67702-96de-4aea-89c4-eb318f4d41ba tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.237952 Aug 12 12:22:07.740099 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 255/527] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:07 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:07.747269 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.751492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.752067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.753806 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.754340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.754858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.803226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:07.803885 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:07.810395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.810889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.811867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.812013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:07.812467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:07.813102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:07.820340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:07.828034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-eaa1c127-31d3-4301-b07c-41682858b699 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1274 microversion: 2.1 time: 0.096271 Aug 12 12:22:07.828603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 273/528] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:07 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:07.946928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:07.954576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9d69ad22-f3da-482c-aace-9a1ad82e9998 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.155863 Aug 12 12:22:07.955187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 256/529] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:07 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:08.751368 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:08.751963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:08.758286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:08.758776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:08.759289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:08.759974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:08.760433 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:08.760895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:08.761179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:08.761789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:08.768826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:08.769331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:08.769763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:08.770448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:08.770894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:08.771415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:08.979165 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:08.982223 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:08.987247 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b28583fc-b2a7-43fb-9905-9149f9d816b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.239798 Aug 12 12:22:08.987900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 274/530] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:08 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:08.990370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d4a5331b-777a-45bb-a635-a810d3eaf520 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.233009 Aug 12 12:22:08.991024 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 257/531] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:08 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:08.992317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:08.993241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:08.995763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:08.997019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:08.999306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:08.999957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:09.000546 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:09.001260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:09.001714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:09.002745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:09.004430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:09.004995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:09.005436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:09.006128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:09.006598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:09.008899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:09.026811 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:09.075357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:09.083661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b01297ea-97d9-4608-8743-808642f2eb15 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1274 microversion: 2.1 time: 0.094796 Aug 12 12:22:09.084230 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 275/532] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:08 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:09.158126 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:09.165650 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eb7214d8-c4d7-44bf-b297-52ba05048574 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.173480 Aug 12 12:22:09.166204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 258/533] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:08 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:10.007367 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:10.007883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:10.013805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:10.013985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:10.014415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:10.014596 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:10.014700 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:10.015358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:10.015803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:10.016219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:10.021993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:10.022473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:10.022906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:10.023590 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:10.024042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:10.024462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:10.207621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:10.215073 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e37bbc20-c08d-410c-b00b-d04666417848 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.211559 Aug 12 12:22:10.215645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 276/534] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:10 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:10.219452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:10.220732 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:10.221337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:10.227106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-186db80b-ab26-4729-8266-67c6a5bed3d5 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.216940 Aug 12 12:22:10.227262 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:10.227645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:10.227779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 259/535] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:10 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:10.228442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:10.229401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:10.230050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:10.230473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:10.235325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:10.235325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:10.238899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:10.239391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:10.239822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:10.240502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:10.240975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:10.241393 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:10.303209 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:10.312166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b917c2e9-18f9-4a55-a6d5-3840a7551a27 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1274 microversion: 2.1 time: 0.095500 Aug 12 12:22:10.312988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 277/536] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:10 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:10.390760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:10.398677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-716328b7-c93c-4747-b6e0-a238a5211f73 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.170079 Aug 12 12:22:10.399336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 260/537] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:10 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:11.235523 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:11.236657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:11.242788 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:11.243239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:11.243851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:11.244750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:11.245825 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:11.246554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:11.255434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:11.260625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:11.266003 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:11.266640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:11.267072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:11.269568 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:11.270366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:11.270793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:11.455955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:11.463962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-10aced71-33ab-4c89-8987-ebd799ff5dce tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1363 microversion: 2.1 time: 0.232573 Aug 12 12:22:11.464543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 278/538] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:11 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:11.469090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:11.469688 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:11.476701 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:11.485032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:11.485933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:11.486486 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:11.487328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:11.487797 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:11.488228 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:11.492964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4c7d3a4a-4e12-4fdd-a6a4-79723deefd95 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.241995 Aug 12 12:22:11.493540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 261/539] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:11 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:11.498386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:11.498996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:11.505134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:11.505618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:11.506052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:11.506743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:11.507202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:11.507626 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:11.558558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:11.567675 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-158d4a47-82a9-4b56-98e2-ef6f8341d6e8 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1274 microversion: 2.1 time: 0.102074 Aug 12 12:22:11.568262 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 279/540] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:11 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:11.655236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:11.664900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b51fcaaa-f5f9-49ba-a6d5-29e0eb52a2bc tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1508 microversion: 2.1 time: 0.170155 Aug 12 12:22:11.665472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 262/541] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:11 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:12.486631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:12.487349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:12.493394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.493916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.494438 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.495075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.495524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.495961 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.514379 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:12.515869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:12.523264 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.523783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.524217 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.524935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.525581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.526000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.723573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:12.729749 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:12.731915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-984ab737-1164-4e33-9c82-acc02fbc8408 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1548 microversion: 2.1 time: 0.249824 Aug 12 12:22:12.732494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 280/542] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:12 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1548 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:12.737510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:12.738107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:12.744287 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.744448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.744917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.745599 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.746047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.746471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.755565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4951d02d-5ea8-4b86-9f35-e20d329e627c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.245609 Aug 12 12:22:12.768678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 263/543] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:12 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:12.768678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:12.768678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:12.771876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.771876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.771876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.771876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.772235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.772562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.816151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:12.823962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9c8f4ebe-64ea-4f18-9ed7-34f0795e1487 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1272 microversion: 2.1 time: 0.090271 Aug 12 12:22:12.824955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 281/544] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:12 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:12.829771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:12.830436 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:12.836289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.836816 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.837555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.838282 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:12.838729 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:12.839154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:12.957866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-05c51fa5-35a7-4851-aff8-e73cb0bbbc1b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131645 Aug 12 12:22:12.960580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 282/545] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 12 12:22:12 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:13.022097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:13.030674 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a33f9afb-7694-4c5e-bce3-624469cfa3d0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1514 microversion: 2.1 time: 0.273200 Aug 12 12:22:13.031259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 264/546] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:12 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:13.779830 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:13.783734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:13.785449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:13.789755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:13.790375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:13.791390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:13.793029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:13.793677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:13.794290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:13.844670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:13.846146 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:13.862391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:13.863009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:13.863629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:13.864907 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:13.865364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:13.865788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:13.959697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:13.968729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9335cb76-e93c-48a1-8ef5-1825e8d51932 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1272 microversion: 2.1 time: 0.127650 Aug 12 12:22:13.976607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 265/547] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:13 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:14.085248 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:14.097060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0c86e968-29d5-4657-83a5-0b193792beb0 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.321067 Aug 12 12:22:14.098652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 283/548] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:13 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:14.576433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-ef21fb3c-8c6a-46b7-980b-04f509281026 req-da5c82d3-9515-4fb6-9a94-067ce4e02e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f381d7-b452-42ba-a0f0-1b4b74c3e07a", "tag": "6c4badc5-44f5-4d36-830c-0a3fb6d17014"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:14.583027 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:14.586932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ef21fb3c-8c6a-46b7-980b-04f509281026 req-da5c82d3-9515-4fb6-9a94-067ce4e02e53 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:14.587946 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ef21fb3c-8c6a-46b7-980b-04f509281026 req-da5c82d3-9515-4fb6-9a94-067ce4e02e53 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:14.587946 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ef21fb3c-8c6a-46b7-980b-04f509281026 req-da5c82d3-9515-4fb6-9a94-067ce4e02e53 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:14.607455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-ef21fb3c-8c6a-46b7-980b-04f509281026 req-da5c82d3-9515-4fb6-9a94-067ce4e02e53 service nova] Creating event network-changed:6c4badc5-44f5-4d36-830c-0a3fb6d17014 for instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a on hv-cinder-79797 Aug 12 12:22:14.607760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-ef21fb3c-8c6a-46b7-980b-04f509281026 req-da5c82d3-9515-4fb6-9a94-067ce4e02e53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034889 Aug 12 12:22:14.608222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 266/549] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:14.991207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:14.992423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:14.999018 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:14.999884 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:15.000323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:15.001255 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:15.001803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:15.002231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:15.119782 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:15.121128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:15.130314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:15.131030 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:15.131645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:15.134180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:15.134180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:15.134180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:15.408964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:15.417574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c4448d68-2a32-40aa-b973-afe24c4a4002 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.430629 Aug 12 12:22:15.418279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 284/550] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:14 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:15.460495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:15.463926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f497ddea-51b2-4f56-9209-c0f32241031e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1314 microversion: 2.1 time: 0.349094 Aug 12 12:22:15.466159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 267/551] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:15 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:15.785891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a17600c0-f421-43ff-a156-cddff01171fd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'create', calling method: .version_select at 0x7f99140358b0>, body: {"keypair": {"name": "tempest-keypair-1503459845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHwUINmS2+zLxQiQhhow2INZRwRZNK0/gBmpwWXlv0WmwOcZGOELF18XPjIaPe01/YlGrfAAgSGEddQ9V+A/WK5rEflna9xeqNj5Iyzj1Whw4dOQyBpLa2spZe4JguFmg=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:15.804766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-a17600c0-f421-43ff-a156-cddff01171fd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Getting quotas for project 2e8def85acdd4e308bb51b4063c2ab4e. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:22:15.809842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-a17600c0-f421-43ff-a156-cddff01171fd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Getting quotas for user 099b87a6c6b8409ab188c0b71ded7f55 and project 2e8def85acdd4e308bb51b4063c2ab4e. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:22:15.928893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a17600c0-f421-43ff-a156-cddff01171fd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150574 Aug 12 12:22:15.929666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 285/552] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:22:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:16.426762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-1bd1eda6-429b-4609-8fe4-3cc0f56d3d84 req-0cc345bf-4a81-4eba-9100-445514760e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d0a328-11a0-452e-960b-63e1daa80ac5", "tag": "a1a6e63a-d923-43fe-b209-981512606f03"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:16.437443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1bd1eda6-429b-4609-8fe4-3cc0f56d3d84 req-0cc345bf-4a81-4eba-9100-445514760e0d service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:16.438062 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1bd1eda6-429b-4609-8fe4-3cc0f56d3d84 req-0cc345bf-4a81-4eba-9100-445514760e0d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:16.438499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1bd1eda6-429b-4609-8fe4-3cc0f56d3d84 req-0cc345bf-4a81-4eba-9100-445514760e0d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:16.440775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:16.442050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:16.451222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:16.451222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:16.451222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:16.451785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:16.452244 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:16.452727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:16.456569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-1bd1eda6-429b-4609-8fe4-3cc0f56d3d84 req-0cc345bf-4a81-4eba-9100-445514760e0d service nova] Creating event network-changed:a1a6e63a-d923-43fe-b209-981512606f03 for instance 57d0a328-11a0-452e-960b-63e1daa80ac5 on hv-cinder-79797 Aug 12 12:22:16.464142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-1bd1eda6-429b-4609-8fe4-3cc0f56d3d84 req-0cc345bf-4a81-4eba-9100-445514760e0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041018 Aug 12 12:22:16.466564 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 268/553] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:16.493794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:16.495130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:16.501295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:16.501811 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:16.502307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:16.503020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:16.503646 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:16.504074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:16.680731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:16.691307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:16.691906 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8141505e-bc42-4da3-9a0c-a28753d3e7eb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.256375 Aug 12 12:22:16.693061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 286/554] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:16 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:16.701318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9c7dad22-e21f-4268-81b2-3321365535f3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1498 microversion: 2.1 time: 0.219448 Aug 12 12:22:16.701881 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 269/555] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:16 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1498 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:17.713213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:17.713819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:17.719888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:17.720572 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:17.721185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:17.721879 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:17.722326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:17.722739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:17.766399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:17.767394 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:17.774636 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:17.775194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:17.775717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:17.776472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:17.777423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:17.778072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:17.811281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:22:18.138019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-59ae86c6-43ff-430c-b332-87877935ea5a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 204 len: 0 microversion: 2.1 time: 0.375326 Aug 12 12:22:18.139963 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 270/556] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:22:17 2022] DELETE /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 12:22:18.153705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:18.154781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:18.162256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:18.163040 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:18.163680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:18.164571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:18.165236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:18.165872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:18.300915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:18.309484 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d65c3305-e99d-4053-9d50-b80c0adcea5e tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.599958 Aug 12 12:22:18.323084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 287/557] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:17 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:18.363530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:18.371887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c0dea73c-d8a3-4a33-bc18-ad2eaad1ca8a tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1504 microversion: 2.1 time: 0.227895 Aug 12 12:22:18.372537 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 271/558] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:18 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:19.088937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2124842724", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a6b8fb6-7157-42e0-853d-3067decf9a0e"}], "security_groups": [{"name": "tempest-securitygroup--1634931054"}], "key_name": "tempest-keypair-1503459845", "user_data": "}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:19.194912 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] validate_networks() for [('2a6b8fb6-7157-42e0-853d-3067decf9a0e', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:22:19.330868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:19.333410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:19.342210 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:19.343120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:19.344230 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:19.346138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:19.346869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:19.347308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:19.581185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:19.598862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-70f40298-b1aa-4148-94d9-d37e82271656 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.271906 Aug 12 12:22:19.599757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 272/559] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:19 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:19.605425 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:19.607426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:19.628514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:19.632203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:19.632989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:19.635545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:19.636087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:19.636589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:19.755650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:22:19.756316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:22:19.757144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:22:19.757946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:22:19.758545 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:22:19.770957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:19.771690 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:19.772223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:19.773074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:19.773883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:19.774794 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:19.799254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Getting quotas for project 2e8def85acdd4e308bb51b4063c2ab4e. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:22:19.803504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Getting quotas for user 099b87a6c6b8409ab188c0b71ded7f55 and project 2e8def85acdd4e308bb51b4063c2ab4e. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:22:19.819071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:22:19.821471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:22:19.844072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:19.852554 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-34c264df-b3b4-41de-9c6a-3000b387b0c3 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1504 microversion: 2.1 time: 0.251206 Aug 12 12:22:19.853564 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 273/560] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:19 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:19.987313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7af59ea0-ab51-44da-b861-4f7c06652489 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.902864 Aug 12 12:22:19.987942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 288/561] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:22:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:22:20.007302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c41c3988-b804-4322-b908-9422e9f0e59f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:20.012447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c41c3988-b804-4322-b908-9422e9f0e59f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:20.071761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c41c3988-b804-4322-b908-9422e9f0e59f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:20.080734 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c41c3988-b804-4322-b908-9422e9f0e59f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1246 microversion: 2.1 time: 0.085281 Aug 12 12:22:20.082906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 274/562] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:19 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:20.624894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:20.628496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:20.633214 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:20.633700 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:20.634131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:20.634895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:20.635342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:20.635760 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:20.640140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:20.783362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:20.791205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fdfc50d0-0408-4a20-a1b3-429e8dfaebb6 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.170524 Aug 12 12:22:20.791789 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 289/563] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:20 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:20.874797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:20.876776 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:20.888629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:20.888629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:20.888629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:20.888629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:20.889103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:20.889103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:21.037826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:21.039288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:21.043766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3037f69a-d920-4c71-9b37-4f3a69eb2ca2 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1504 microversion: 2.1 time: 0.173672 Aug 12 12:22:21.044561 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 275/564] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:20 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:21.103454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:21.103454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:21.110862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:21.111666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:21.112183 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:21.113169 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:21.113655 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:21.114345 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:21.189162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:21.196931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8ece6009-ce4d-4928-a9a4-853d68bb70b3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1250 microversion: 2.1 time: 0.098618 Aug 12 12:22:21.197505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 290/565] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:21 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1250 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:21.813265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:21.814190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:21.821114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:21.821609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:21.822047 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:21.822746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:21.823199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:21.823627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:21.975621 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:21.983272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e6a15a1a-f340-4069-8b0e-c5b3c088d7e7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.175804 Aug 12 12:22:21.983861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 276/566] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:21 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:22.054297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ce538f0-7595-445d-9ad1-fc14a5a97b0c", "device": "/dev/sdb"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:22.057332 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:22.067114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:22.068254 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:22.075649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:22.076847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:22.085186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:22.085186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:22.085426 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:22.085561 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:22.085649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:22.085725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:22.085800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:22.085800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:22.085950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:22.086027 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:22.296420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:22.304199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d2d7ee2a-4856-458b-8e1b-b9c059661da8 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1504 microversion: 2.1 time: 0.242504 Aug 12 12:22:22.304802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 277/567] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:22 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:22.309277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:22.309879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:22.317200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:22.317952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:22.318387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:22.319259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:22.319715 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:22.320139 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:22.412838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:22.421154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ae222ea4-d467-4913-b6bc-023f2649ce9a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1250 microversion: 2.1 time: 0.115305 Aug 12 12:22:22.422111 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 278/568] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:22 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1250 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:23.017541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:23.018164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:23.036261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:23.036261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:23.036261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:23.036261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:23.036705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:23.036705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:23.226963 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:23.236399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-01ce1da7-e6ac-4fd3-bb1f-6a9ccd9eb94a tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.235378 Aug 12 12:22:23.237294 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 279/569] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:22 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:23.335253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:23.335998 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:23.342838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:23.343999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:23.345398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:23.346297 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:23.348105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:23.348735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:23.522651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:23.530168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ad208f40-dc10-4a25-b7f3-9f6bea76a65d tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1504 microversion: 2.1 time: 0.201411 Aug 12 12:22:23.551540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 280/570] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:23 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:23.556404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:23.559082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:23.591139 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:23.592102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:23.592451 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:23.593228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:23.593972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:23.595190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:23.672570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:23.686436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-15440af4-c9fc-4c08-a5c9-162223bc9714 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1250 microversion: 2.1 time: 0.133733 Aug 12 12:22:23.687283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 281/571] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:23 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1250 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:24.258908 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:24.259503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:24.266854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:24.267495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:24.267932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:24.268661 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:24.269154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:24.269577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:24.440673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a1a1e340-81b2-4b11-81c3-235c318e5c9c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "POST /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.390075 Aug 12 12:22:24.442534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 291/572] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:22:22 2022] POST /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb/os-volume_attachments => generated 194 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:24.502711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-800a0053-aaa0-4227-a661-9752a46913fc req-06c7b236-50b3-41ed-998b-c12948e55a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a850f119-f584-47aa-b111-e155bcfcbdb2", "name": "network-vif-deleted", "tag": "87ca618f-8ac2-40ab-8a30-1977f61fbad0"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:24.515527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:24.527852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-800a0053-aaa0-4227-a661-9752a46913fc req-06c7b236-50b3-41ed-998b-c12948e55a48 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:24.528577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-800a0053-aaa0-4227-a661-9752a46913fc req-06c7b236-50b3-41ed-998b-c12948e55a48 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:24.529311 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-800a0053-aaa0-4227-a661-9752a46913fc req-06c7b236-50b3-41ed-998b-c12948e55a48 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:24.529969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f4a18c84-ce7c-481b-b84d-d25f38a80d5d tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.274774 Aug 12 12:22:24.531649 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 282/573] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:24 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:24.543296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-800a0053-aaa0-4227-a661-9752a46913fc req-06c7b236-50b3-41ed-998b-c12948e55a48 service nova] Creating event network-vif-deleted:87ca618f-8ac2-40ab-8a30-1977f61fbad0 for instance a850f119-f584-47aa-b111-e155bcfcbdb2 on hv-cinder-79797 Aug 12 12:22:24.548558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-800a0053-aaa0-4227-a661-9752a46913fc req-06c7b236-50b3-41ed-998b-c12948e55a48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063574 Aug 12 12:22:24.549208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 292/574] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:22:24.551736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:24.552349 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:24.558643 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:24.559240 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:24.559740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:24.560499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:24.561155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:24.561738 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:24.629079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:24.637100 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5b14d7c2-c5dd-4bb1-9097-88b5cbadd869 tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1462 microversion: 2.1 time: 0.089119 Aug 12 12:22:24.637799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 283/575] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:24 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:24.709371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:24.710297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:24.717021 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:24.717508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:24.717951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:24.719093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:24.719941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:24.720564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:24.797896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:24.824563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7c045190-a768-44b3-bb37-9bc8f4036b2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1298 microversion: 2.1 time: 0.120665 Aug 12 12:22:24.825766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 293/576] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:24 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:25.438099 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:22:25.438872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:22:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:22:25.555704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:25.556929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:25.567598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:25.570695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:25.571501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:25.572780 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:25.573388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:25.574617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:25.659958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:25.661381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:25.670311 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:25.675049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:25.675721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:25.679939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:25.680631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:25.681251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:25.775835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:25.776330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:25.776794 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:25.780763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lazy-loading 'fault' on Instance uuid a850f119-f584-47aa-b111-e155bcfcbdb2 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:25.879470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f5d15687d4a55ac595c8f067d6f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8164da757959471cbbfb3b51af1edebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:25.888605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:25.897876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-41e0bf90-2b3b-46e3-98bb-b3351c6b499e tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 200 len: 1304 microversion: 2.1 time: 0.241420 Aug 12 12:22:25.899421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 294/577] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:25 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:25.901335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-96b692b2-808c-4b9b-9767-a49bcbeacd68 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.350104 Aug 12 12:22:25.905220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:25.906002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 284/578] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:25 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:25.906160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:25.913945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:25.914747 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:25.915355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:25.916059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:25.916542 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:25.917031 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:25.995295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:26.007294 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3dd2731d-f830-4b09-9679-86836dbcb025 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1316 microversion: 2.1 time: 0.105314 Aug 12 12:22:26.008394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 295/579] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:25 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1316 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:26.255710 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-64c8b97d-3f6a-4085-ac56-70349b812acc req-0186bd28-d4f2-4811-a7b5-e54336c89046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d0a328-11a0-452e-960b-63e1daa80ac5", "name": "network-vif-plugged", "status": "completed", "tag": "a1a6e63a-d923-43fe-b209-981512606f03"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:26.266828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-64c8b97d-3f6a-4085-ac56-70349b812acc req-0186bd28-d4f2-4811-a7b5-e54336c89046 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:26.272500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-64c8b97d-3f6a-4085-ac56-70349b812acc req-0186bd28-d4f2-4811-a7b5-e54336c89046 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:26.272500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-64c8b97d-3f6a-4085-ac56-70349b812acc req-0186bd28-d4f2-4811-a7b5-e54336c89046 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:26.281391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-64c8b97d-3f6a-4085-ac56-70349b812acc req-0186bd28-d4f2-4811-a7b5-e54336c89046 service nova] Creating event network-vif-plugged:a1a6e63a-d923-43fe-b209-981512606f03 for instance 57d0a328-11a0-452e-960b-63e1daa80ac5 on hv-cinder-79797 Aug 12 12:22:26.290572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-64c8b97d-3f6a-4085-ac56-70349b812acc req-0186bd28-d4f2-4811-a7b5-e54336c89046 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043482 Aug 12 12:22:26.291797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 285/580] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:26.921468 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:26.922755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] [instance: a850f119-f584-47aa-b111-e155bcfcbdb2] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:26.926937 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:26.927878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:26.940501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:26.941035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:26.943979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:26.944689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:26.945577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:26.946406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:26.946884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:26.950979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:26.951106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:26.951106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:26.951106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:26.951106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:26.968718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] HTTP exception thrown: Instance a850f119-f584-47aa-b111-e155bcfcbdb2 could not be found. Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Request method failure captured: Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 HTTP/1.1 Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kWm35Qh1F_EV2ysCC9bQN6VbZIHqAO5oWN9NGn4UAUUX7RY_SvqanHIvCYuyqPzli3nzpvJaidXuuaQoPlFnRerCt4lVK1ZRfAR_klvap-T0KYtnOngxgBwn2z2lRpQyEJreIrMs4Ls5EY_zsdyt6uuiBpI2l0TDQ1V9zeuf4gTwVc Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 8164da757959471cbbfb3b51af1edebd Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesActionsTest-996623237 Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:22:26.972907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8164da757959471cbbfb3b51af1edebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8164da757959471cbbfb3b51af1edebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8164da757959471cbbfb3b51af1edebd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8164da757959471cbbfb3b51af1edebd"}]}] Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesActionsTest-996623237 Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 8164da757959471cbbfb3b51af1edebd Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesActionsTest-996623237 Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesActionsTest-996623237-project Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 011f5d15687d4a55ac595c8f067d6f1d Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesActionsTest-996623237-project Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance a850f119-f584-47aa-b111-e155bcfcbdb2 could not be found. Aug 12 12:22:26.974333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'a850f119-f584-47aa-b111-e155bcfcbdb2'} Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a850f119-f584-47aa-b111-e155bcfcbdb2 could not be found. Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:22:26.975070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a850f119-f584-47aa-b111-e155bcfcbdb2 could not be found. Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a850f119-f584-47aa-b111-e155bcfcbdb2 could not be found. Aug 12 12:22:26.978727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:22:26.979864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] Returning 404 to user: Instance a850f119-f584-47aa-b111-e155bcfcbdb2 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:22:26.979864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fe156cc6-bbf7-447b-bca8-7b7b08f6854c tempest-VolumesActionsTest-996623237 tempest-VolumesActionsTest-996623237-project] 10.222.0.27 "GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2" status: 404 len: 111 microversion: 2.1 time: 0.058219 Aug 12 12:22:26.979864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 296/581] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:26 2022] GET /compute/v2.1/servers/a850f119-f584-47aa-b111-e155bcfcbdb2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:22:27.038292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:27.038909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:27.049977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:27.050889 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:27.053134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:27.056297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:27.058073 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:27.061315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:27.428602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:27.436984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0aa1b543-29ee-4b5b-9bee-4d059d5175cb tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.514275 Aug 12 12:22:27.437687 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 286/582] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:26 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:27.937471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:27.946634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6649816f-39ba-4c00-9574-a341a4112b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.912340 Aug 12 12:22:27.955909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 297/583] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:27 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:28.458609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:28.475778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:28.478369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:28.478822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:28.479261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:28.481698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:28.494637 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:28.494637 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:28.818817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-a6293740-434b-4667-beee-24d42ef407ed req-e5736c9d-aeca-45f7-ad4c-968e868e2198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836dc0f4-7d00-4730-9828-909cded7ec39", "tag": "30720ab8-0d22-48fe-b3f3-2941ca200322"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:28.845682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-a6293740-434b-4667-beee-24d42ef407ed req-e5736c9d-aeca-45f7-ad4c-968e868e2198 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:28.846159 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-a6293740-434b-4667-beee-24d42ef407ed req-e5736c9d-aeca-45f7-ad4c-968e868e2198 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:28.846579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-a6293740-434b-4667-beee-24d42ef407ed req-e5736c9d-aeca-45f7-ad4c-968e868e2198 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:28.866841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-a6293740-434b-4667-beee-24d42ef407ed req-e5736c9d-aeca-45f7-ad4c-968e868e2198 service nova] Creating event network-changed:30720ab8-0d22-48fe-b3f3-2941ca200322 for instance 836dc0f4-7d00-4730-9828-909cded7ec39 on hv-cinder-79797 Aug 12 12:22:28.882107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-a6293740-434b-4667-beee-24d42ef407ed req-e5736c9d-aeca-45f7-ad4c-968e868e2198 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067597 Aug 12 12:22:28.882714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 298/584] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:28.976401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:28.977155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:28.985761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:28.986258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:28.986714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:28.987648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:28.988183 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:28.988530 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:29.004331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:29.017996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a2094c45-a3ac-49de-b00a-e15b9dcfe24b tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.563593 Aug 12 12:22:29.019225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 287/585] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:28 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:29.231305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:29.239570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-57316818-0bbe-408c-9b6a-e4961a845c27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.267679 Aug 12 12:22:29.240395 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 299/586] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:28 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:30.039140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:30.039800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:30.046364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:30.047781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:30.048739 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:30.049599 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:30.050223 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:30.050654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:30.085233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:30.237266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:30.244995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6b359d4b-a814-481f-a21c-cd87c2f9daae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.209862 Aug 12 12:22:30.245567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 288/587] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:30 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:30.260930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:30.261532 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:30.263444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:30.264239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=10 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:30.270054 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:30.270537 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:30.270964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:30.271641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:30.272084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:30.272543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:30.510016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:30.518692 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e2ddb1f6-63f6-4ff4-a1eb-b68c84f1accf tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.261652 Aug 12 12:22:30.527606 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 300/588] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:30 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:31.267171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:31.267904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:31.274939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:31.275428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:31.275864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:31.276565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:31.277074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:31.277500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:31.452046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:31.462920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4666e382-f50a-449c-b70d-3f29a4a3d891 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.200171 Aug 12 12:22:31.463754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 289/589] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:31 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:31.541810 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:31.542787 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:31.549945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:31.554037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:31.554037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:31.554037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:31.554037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:31.554422 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:31.712737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:31.722259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-836ad513-35ee-4190-a04d-4c9fa26ad7d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.185752 Aug 12 12:22:31.722914 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 301/590] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:31 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:32.483732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:32.552456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:32.552456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:32.552456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:32.552456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:32.552878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:32.552878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:32.552878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:32.679342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:32.688756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e180f6e8-3c62-446d-bb20-50aa907dda09 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1314 microversion: 2.1 time: 0.208844 Aug 12 12:22:32.689420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 290/591] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:32 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:32.745219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:32.745839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:32.752193 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:32.752691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:32.753130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:32.753807 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:32.754254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:32.754683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:32.922911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:32.932381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6790e40e-0b62-4c69-bd0c-5b48c1ff4b60 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.191355 Aug 12 12:22:32.938298 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 302/592] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:32 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:33.711790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:33.713178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:33.720475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:33.726813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:33.726813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:33.726813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:33.726813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:33.727159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:33.876893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:33.885320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-da2ad68e-9be9-494e-a771-01d9b3afd5e2 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1464 microversion: 2.1 time: 0.178405 Aug 12 12:22:33.892563 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 291/593] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:33 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:33.942221 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:33.943117 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:33.950199 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:33.950766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:33.951302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:33.951302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:33.951302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:33.960825 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:33.966599 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:33.966897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:33.973842 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:33.974427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:33.976760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:33.977613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:33.978165 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:33.979301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:34.016834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Going to try to terminate instance {{(pid=121154) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:22:34.180429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:34.189651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-428a463e-d193-4d6b-8f37-67b1daebcb1b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.234705 Aug 12 12:22:34.191570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 292/594] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:33 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:34.383242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3cdccb48-f8b1-4fb3-8596-3b5555bdf36c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "DELETE /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 204 len: 0 microversion: 2.1 time: 0.448307 Aug 12 12:22:34.383830 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 303/595] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:22:33 2022] DELETE /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:22:34.392524 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:34.393394 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:34.399560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:34.400760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:34.400760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:34.401475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:34.401934 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:34.402365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:34.408027 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:34.543507 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:34.551847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5533a745-15b9-42e0-bbab-54e29d571cae tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1470 microversion: 2.1 time: 0.163307 Aug 12 12:22:34.552422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 293/596] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:34 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:35.226725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:35.229213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:35.260803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:35.260803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:35.260803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:35.269005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:35.269646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:35.269966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:35.330201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:35.486140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:35.495544 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-90d3f6dc-2e2f-4c63-ae5f-851d52138e83 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.286743 Aug 12 12:22:35.510101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 304/597] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:35 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:35.574397 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:35.575015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:35.582308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:35.585259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:35.585259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:35.585259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:35.585259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:35.585640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:35.776500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:35.787644 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-22f57389-5e33-43f2-9151-67e576e19e0c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1470 microversion: 2.1 time: 0.217155 Aug 12 12:22:35.808817 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 294/598] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:35 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:36.519857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:36.520473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:36.532339 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:36.537190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:36.537649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:36.540391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:36.544146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:36.546893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:36.744459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:36.754029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-22c6154c-d377-42f9-8d92-ff1137b6afc9 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.240125 Aug 12 12:22:36.755055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 305/599] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:36 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:36.822036 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:36.823152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:36.916369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:36.916369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:36.916369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:36.916369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:36.916870 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:36.916870 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:37.272352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:37.304971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ecc94b4-57a0-4ad9-85a4-82a08bf59fc3 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1470 microversion: 2.1 time: 0.467924 Aug 12 12:22:37.304971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 295/600] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:36 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1470 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:37.775113 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:37.775722 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:37.786393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:37.786898 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:37.787332 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:37.788042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:37.788481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:37.788925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:38.307337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:38.308680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:38.325286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:38.326021 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:38.326625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:38.328116 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:38.328742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:38.329526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:38.904778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:38.915478 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fdb3d020-ee79-40ce-8bed-a0899412e0ff tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1470 microversion: 2.1 time: 0.612003 Aug 12 12:22:38.925513 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:38.933822 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-99bcb588-5fcf-4e9a-a751-47f12c27363b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 1.162684 Aug 12 12:22:38.939615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 296/601] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:38 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1470 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:38.946434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-b2e8ed3c-8220-404a-9a70-a7ed826efa0a req-2d957f02-ba4c-47e8-8214-28b903240162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d0a328-11a0-452e-960b-63e1daa80ac5", "name": "network-vif-deleted", "tag": "a1a6e63a-d923-43fe-b209-981512606f03"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:38.960585 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 306/602] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:37 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:38.976900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b2e8ed3c-8220-404a-9a70-a7ed826efa0a req-2d957f02-ba4c-47e8-8214-28b903240162 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:38.977723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b2e8ed3c-8220-404a-9a70-a7ed826efa0a req-2d957f02-ba4c-47e8-8214-28b903240162 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:38.978258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b2e8ed3c-8220-404a-9a70-a7ed826efa0a req-2d957f02-ba4c-47e8-8214-28b903240162 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:39.016667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-b2e8ed3c-8220-404a-9a70-a7ed826efa0a req-2d957f02-ba4c-47e8-8214-28b903240162 service nova] Creating event network-vif-deleted:a1a6e63a-d923-43fe-b209-981512606f03 for instance 57d0a328-11a0-452e-960b-63e1daa80ac5 on hv-cinder-79797 Aug 12 12:22:39.046945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-b2e8ed3c-8220-404a-9a70-a7ed826efa0a req-2d957f02-ba4c-47e8-8214-28b903240162 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103170 Aug 12 12:22:39.053590 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 297/603] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:39.961049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:39.965769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:39.973329 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:39.974020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:39.984716 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:39.986947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:39.987694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:39.988441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:39.989808 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:39.990551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:39.995677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:39.997352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:39.997985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:39.999127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:40.000241 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:40.000866 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:40.106257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:40.106876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:40.107364 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:40.107909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:40.178622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:40.188744 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d7379cc4-7e0d-448d-a803-f3174bbf23aa tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.232897 Aug 12 12:22:40.194715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 307/604] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:39 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:40.674909 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:40.684015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c4a78c33-8b5b-4400-9176-fe45857a7587 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.714683 Aug 12 12:22:40.698147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 298/605] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:39 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:41.215408 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:41.216949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:41.226957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:41.228541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:41.229578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:41.231142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:41.231934 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:41.232591 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:41.320449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:41.321214 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:41.321799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:41.322408 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:41.387697 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:41.403641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9fc27bfd-8ea8-4f47-ae0f-83ee90143272 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.191855 Aug 12 12:22:41.404571 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 308/606] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:41 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:41.705484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:41.706087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:41.722399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:41.722889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:41.723321 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:41.724016 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:41.724462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:41.724914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:41.997150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:42.005710 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6ed34ea7-164e-4bcd-b5f7-99da9aea014c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.304190 Aug 12 12:22:42.007778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 299/607] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:41 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:42.428330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:42.429207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:42.437675 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:42.443618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:42.444589 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:42.449039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:42.449745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:42.453548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:42.518557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:42.519300 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:42.519919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:42.520540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:42.579542 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:42.589068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e3ec5508-2c4b-4d66-b84d-95be4e804548 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.164892 Aug 12 12:22:42.590951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 309/608] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:42 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:43.026947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:43.027562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:43.035597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:43.036095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:43.036532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:43.037270 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:43.037721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:43.038147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:43.174411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:43.181995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f42866c7-04ae-450d-a8c9-2c923cfe4eb3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.158832 Aug 12 12:22:43.182785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 300/609] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:43 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:43.611562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:43.612157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:43.621580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:43.622080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:43.622874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:43.623307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:43.624170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:43.624803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:43.658946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:43.659435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:43.660016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:43.661044 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:43.718866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:43.728909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-96716911-c6f3-402d-9aae-5553fe658320 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.121251 Aug 12 12:22:43.729487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 310/610] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:43 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:44.203443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:44.204789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:44.212074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:44.212571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:44.213106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:44.213807 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:44.214268 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:44.214692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:44.361570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:44.370087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-591876a9-3d14-44bf-b29f-1c85e7418d69 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.170606 Aug 12 12:22:44.384519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 301/611] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:44 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:44.558139 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7f3963cf-6bb5-43fd-a04b-95d7a0f4fb50 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Action: 'create', calling method: .version_select at 0x7f990efae1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1228588657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxM4qJGcd35liHScoPGcPUngh/U24D7WgT04mDFRr7JCFxSGbEc73nWERKXQSLKeZigSNMGcun95sM5lMBsCNpPNgFc8fdI+BtKOWixQIKEeEPvoe/T4h9JYl1BNezqjQ=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:44.573688 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:44.580387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-7f3963cf-6bb5-43fd-a04b-95d7a0f4fb50 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Getting quotas for project 478411e9884545398aa7fbec4279a57b. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:22:44.584288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-7f3963cf-6bb5-43fd-a04b-95d7a0f4fb50 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Getting quotas for user fbd28b2571a540e7bdd9c15684dee82d and project 478411e9884545398aa7fbec4279a57b. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:22:44.659430 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7f3963cf-6bb5-43fd-a04b-95d7a0f4fb50 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.106202 Aug 12 12:22:44.672717 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 311/612] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:22:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:44.717763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1184212678", "imageRef": "1a803a75-6af2-4896-bc23-e2db093b839e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1228588657", "networks": [{"uuid": "7b52d907-f54f-46eb-8b0b-7eb43e6c9e6b"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:44.753292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:44.754144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:44.761919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:44.762683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:44.763357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:44.764451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:44.765253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:44.765880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:44.786590 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] validate_networks() for [('7b52d907-f54f-46eb-8b0b-7eb43e6c9e6b', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:22:44.801584 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:44.802560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:44.803205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:44.803862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:44.891714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:44.901694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5eb6ba2f-349b-4ab1-937d-b18d5e232405 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.153490 Aug 12 12:22:44.908964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 312/613] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:44 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:45.245475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:22:45.245888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:22:45.246187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:22:45.246640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:22:45.247251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:22:45.257120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:45.257632 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:45.258075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:45.258998 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:45.259463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:45.259961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:45.281375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Getting quotas for project 478411e9884545398aa7fbec4279a57b. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:22:45.286231 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Getting quotas for user fbd28b2571a540e7bdd9c15684dee82d and project 478411e9884545398aa7fbec4279a57b. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:22:45.298778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:22:45.301141 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a803a75-6af2-4896-bc23-e2db093b839e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:22:45.397044 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:45.397750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:45.407893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:45.408476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:45.409034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:45.409822 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:45.410408 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:45.410882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:45.437078 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-92949520-80c2-4ef3-9c72-48e3c9978667 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723699 Aug 12 12:22:45.437891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 302/614] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:22:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:22:45.457794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8aacf9c8-bd44-48bb-836e-a3dfe7ecfb34 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:45.458967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8aacf9c8-bd44-48bb-836e-a3dfe7ecfb34 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:45.471717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:45.564882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8aacf9c8-bd44-48bb-836e-a3dfe7ecfb34 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:45.574575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8aacf9c8-bd44-48bb-836e-a3dfe7ecfb34 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1259 microversion: 2.1 time: 0.129919 Aug 12 12:22:45.593225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 303/615] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:45 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:45.652679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:45.662732 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f79cdf18-f210-4de2-a718-152c4b34e6ab tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.274500 Aug 12 12:22:45.664863 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 313/616] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:45 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:45.925501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:45.927374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:45.935760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:45.936629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:45.937341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:45.938363 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:45.938875 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:45.939503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:45.989362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:45.989950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:45.990318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:45.990899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:46.057264 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:46.065945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6f1757e5-a582-4fed-912d-73d8fcd8f331 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.145117 Aug 12 12:22:46.066716 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 304/617] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:45 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:46.600029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a2c706e4-3d22-4f46-aba1-a3b3595aacdf tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:46.601781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a2c706e4-3d22-4f46-aba1-a3b3595aacdf tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:46.673343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a2c706e4-3d22-4f46-aba1-a3b3595aacdf tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:46.680392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a2c706e4-3d22-4f46-aba1-a3b3595aacdf tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1259 microversion: 2.1 time: 0.088042 Aug 12 12:22:46.680998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 314/618] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:46 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1259 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:46.685557 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:46.686327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:46.694634 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:46.695125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:46.695561 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:46.696285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:46.696796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:46.697222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:46.841505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:46.849939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ca58095a-f890-4bdb-83a6-e059d5ec841d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.168452 Aug 12 12:22:46.850702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 305/619] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:46 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:47.091175 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:47.092192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:47.104290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:47.105314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:47.106231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:47.107173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:47.107849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:47.109491 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:47.145484 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:47.146262 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:47.146686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:47.147131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:47.191156 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:47.201713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cacb01b0-6bc3-4545-bbab-6913cbd7ae2c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.116389 Aug 12 12:22:47.203629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 315/620] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:47 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:47.701929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:47.703301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:47.710267 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:47.710980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:47.711412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:47.712096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:47.712540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:47.712983 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:47.776956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:47.786295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-07558ad9-28e3-4760-8cd3-9045745c33ba tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1263 microversion: 2.1 time: 0.088266 Aug 12 12:22:47.786866 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 306/621] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:47 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:47.871955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:47.873416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:47.880429 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:47.880933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:47.881550 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:47.882421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:47.883310 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:47.883719 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:48.038181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:48.048977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c0ab39d3-c70a-42b8-9aa9-abd645945206 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.180800 Aug 12 12:22:48.049562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 316/622] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:47 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:48.225528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:48.226192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:48.232490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:48.233416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:48.234375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:48.235266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:48.235929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:48.236693 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:48.284501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:48.285386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:48.286051 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:48.286677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:48.331717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:48.349423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-61cdaaa3-8983-4a8c-a13c-e06328fc20d7 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.128355 Aug 12 12:22:48.350183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 307/623] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:48 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:48.814845 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:48.815691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:48.822045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:48.822778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:48.823397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:48.824359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:48.824841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:48.825481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:48.887957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:48.900325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-06a75c3b-635f-4a41-b69c-29903a3f2e8f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1263 microversion: 2.1 time: 0.095990 Aug 12 12:22:48.901335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 317/624] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:48 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1263 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:49.080411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:49.081422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:49.091916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:49.092456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:49.095299 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:49.096562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:49.097813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:49.098728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:49.275677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:49.284530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c9eb8e13-9af0-4a63-b79e-7598eccb11db tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.212294 Aug 12 12:22:49.298556 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 308/625] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:49 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:49.370322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:49.370854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:49.377681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:49.378204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:49.378644 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:49.379385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:49.379839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:49.380267 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:49.419385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:49.419874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:49.421000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:49.422261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:49.473711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:49.488560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f6f71856-8a67-43ab-9217-ec721ca74b62 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.122089 Aug 12 12:22:49.489216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 318/626] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:49 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:49.922990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:49.923879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:49.930658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:49.931433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:49.932113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:49.933070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:49.933611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:49.934278 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:50.007698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:50.016306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2553c2f1-93e6-42fd-a6ad-80c330dcb891 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1263 microversion: 2.1 time: 0.097565 Aug 12 12:22:50.017302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 309/627] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:49 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:50.305319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:50.306515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:50.314140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:50.314867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:50.315452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:50.316362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:50.316860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:50.317457 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:50.455548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:50.464053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3032b4ad-3481-48fd-a7ab-a414c15014b4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.162484 Aug 12 12:22:50.464619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 319/628] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:50 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:50.511428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:50.512270 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:50.522950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:50.523706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:50.524406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:50.525364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:50.526067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:50.526721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:50.575519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:50.576144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:50.576797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:50.577354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:50.632831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:50.643604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2f392eba-55b6-44bb-bcc1-5f36c962e75c tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.137146 Aug 12 12:22:50.644232 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 310/629] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:50 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:51.042215 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:51.042846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:51.049024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:51.049505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:51.050137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:51.050990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:51.051448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:51.051994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:51.118734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:51.122911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:51.128530 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0950f7e8-2121-4292-97df-87d3c526fafd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1263 microversion: 2.1 time: 0.090722 Aug 12 12:22:51.129415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 320/630] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:51 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:51.484599 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:51.485489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:51.492132 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:51.492627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:51.493093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:51.493796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:51.494253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:51.494681 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:51.499675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:51.647180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:51.655580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-33c0e5ac-b15c-4fec-ab2a-e26bce1d545c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.174920 Aug 12 12:22:51.668120 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:51.669577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:51.669843 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 311/631] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:51 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:51.677095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:51.677796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:51.680225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:51.681219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:51.682150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:51.683155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:51.731499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:51.732122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:51.732673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:51.733289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:51.779851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:51.793050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-353b3ff7-c0a5-4b92-a61e-4894ca976a97 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.130599 Aug 12 12:22:51.794062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 321/632] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:51 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:52.162575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:52.163194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:52.169619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:52.170114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:52.170548 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:52.171281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:52.171735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:52.172431 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:52.251434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:52.268607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-46177b11-b60e-401e-9677-996ca178984c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1263 microversion: 2.1 time: 0.110517 Aug 12 12:22:52.269269 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 312/633] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:52 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1263 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:52.681878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:52.682991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:52.692027 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:52.692923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:52.693828 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:52.694943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:52.695393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:52.696015 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:52.822545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:52.823711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:52.841755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:52.842541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:52.843174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:52.844080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:52.844880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:52.845616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:52.887075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:52.887898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:52.888386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:52.888860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:52.889304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:52.897127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c0f6495f-46b6-4692-bdc9-a448e30c2cf2 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.222658 Aug 12 12:22:52.911260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 322/634] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:52 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:52.932146 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:52.940327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ab08fafd-502c-4093-9bf2-1b0b92006690 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.128611 Aug 12 12:22:52.953373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 313/635] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:52 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:22:53.301319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:53.302022 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:53.308405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:53.308930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:53.309372 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:53.310068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:53.310522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:53.310946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:53.387221 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:53.395762 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2a2721ae-fcb8-445d-8d0e-771e9a25904b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1263 microversion: 2.1 time: 0.099105 Aug 12 12:22:53.396357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 323/636] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:53 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1263 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:53.918406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:53.918981 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:53.925468 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:53.925955 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:53.926398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:53.927085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:53.927541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:53.927967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:53.961805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:53.962413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:53.969035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:53.970902 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:53.971352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:53.972180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:53.972634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:53.973084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:54.006951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:54.007834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:54.008461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:54.009255 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lazy-loading 'fault' on Instance uuid 57d0a328-11a0-452e-960b-63e1daa80ac5 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:22:54.072522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b2068b6e8422781a93b4ecef436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a76d86371c448a8ff0596da2235ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:54.081780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1e758353-a12f-4fec-ae65-08a7decd60dc tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 200 len: 1304 microversion: 2.1 time: 0.123930 Aug 12 12:22:54.102731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 324/637] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:53 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:54.102984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:54.102984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7d74348d-ebb4-436f-9042-dc02fb470218 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.183454 Aug 12 12:22:54.102984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 314/638] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:53 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:54.420547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:54.421179 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:54.428302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:54.428814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:54.429243 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:54.429962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:54.430375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:54.430785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:54.495311 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:54.503472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9b53846c-2bb9-4bdb-a51d-0d8e99393165 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1311 microversion: 2.1 time: 0.086772 Aug 12 12:22:54.504289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 325/639] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:54 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:55.103500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:55.104109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] [instance: 57d0a328-11a0-452e-960b-63e1daa80ac5] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:55.110634 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:55.111339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:55.111588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:55.112424 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:55.112910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:55.113342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:55.118519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:55.119128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:55.125526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:55.126183 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:55.126613 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:55.126863 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] HTTP exception thrown: Instance 57d0a328-11a0-452e-960b-63e1daa80ac5 could not be found. Aug 12 12:22:55.127662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:55.128267 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Request method failure captured: Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 HTTP/1.1 Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kXcx9cPfWu7EzbjGSHRB5cvAnrYaveyMwfnptDrKp5vNBtNwvQwxziZow2WqO8S1JN7-qT8DDosFyHIpBnRCHqFTKNDH38XAtcaQ8GRqw4qknwMRu4lV7pSsYC-qgQF0kDqMLqjVnpumUGK4Nh9SFT2Ih8oMYBJbT8nZrXt2PHa_hs Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 58a76d86371c448a8ff0596da2235ba5 Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesNegativeTest-61392253 Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:22:55.128680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58a76d86371c448a8ff0596da2235ba5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58a76d86371c448a8ff0596da2235ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58a76d86371c448a8ff0596da2235ba5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58a76d86371c448a8ff0596da2235ba5"}]}] Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesNegativeTest-61392253 Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 58a76d86371c448a8ff0596da2235ba5 Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesNegativeTest-61392253 Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesNegativeTest-61392253-project Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 013b2068b6e8422781a93b4ecef436bc Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesNegativeTest-61392253-project Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 57d0a328-11a0-452e-960b-63e1daa80ac5 could not be found. Aug 12 12:22:55.130273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '57d0a328-11a0-452e-960b-63e1daa80ac5'} Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d0a328-11a0-452e-960b-63e1daa80ac5 could not be found. Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:22:55.131089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d0a328-11a0-452e-960b-63e1daa80ac5 could not be found. Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d0a328-11a0-452e-960b-63e1daa80ac5 could not be found. Aug 12 12:22:55.132293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:22:55.133429 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:55.134206 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] Returning 404 to user: Instance 57d0a328-11a0-452e-960b-63e1daa80ac5 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:22:55.134206 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-828ce1a7-ab25-4c6c-a630-78ae1b67b507 tempest-VolumesNegativeTest-61392253 tempest-VolumesNegativeTest-61392253-project] 10.222.0.27 "GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5" status: 404 len: 111 microversion: 2.1 time: 0.030584 Aug 12 12:22:55.134206 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 315/640] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:55 2022] GET /compute/v2.1/servers/57d0a328-11a0-452e-960b-63e1daa80ac5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:22:55.279917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:55.288560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c084830c-bb1d-4098-be3d-54aef142a95d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.173895 Aug 12 12:22:55.289162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 326/641] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:55 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:55.525197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:55.525801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:55.527882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:55.535595 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:55.536404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:55.541231 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:55.542126 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:55.542584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:55.545166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:55.569997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=8 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:55.612275 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:55.619902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cbefdd5e-cda5-4d6b-b1a4-7a6061cdb559 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1319 microversion: 2.1 time: 0.098443 Aug 12 12:22:55.620735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 316/642] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:55 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:56.311903 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:56.311903 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:56.319286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:56.319868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:56.320417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:56.321289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:56.321805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:56.322292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:56.466387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:56.477638 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b61e1c47-2413-4c52-ad74-9635ab8ea23f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.168900 Aug 12 12:22:56.477638 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 327/643] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:56 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:56.641331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:56.641995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:56.649775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:56.650258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:56.650690 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:56.651373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:56.651826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:56.652251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:56.794238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:56.804016 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b8709c43-8494-4967-8057-dc814d28bdff tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.167272 Aug 12 12:22:56.805426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 317/644] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:56 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:57.495427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:57.496066 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:57.498136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=6 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:22:57.504311 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:57.504823 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:57.505254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:57.505967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:57.506448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:57.506869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:57.634554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:57.641972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c0921921-3aa4-447e-9cfd-1d0654b89120 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.150396 Aug 12 12:22:57.642567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 328/645] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:57 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:57.832068 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:57.832789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:57.839312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:57.839789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:57.840220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:57.840929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:57.841375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:57.841800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:57.979035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:57.987819 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3c37df51-43db-4fc7-a1b5-1382c869f138 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.159861 Aug 12 12:22:57.988554 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 318/646] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:57 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:58.665075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:58.666258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:58.674445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:58.677446 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:58.677957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:58.678738 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:58.679278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:58.679769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:58.958726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:58.967254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f94bc905-057c-432a-a0e8-69d62e9286a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.307655 Aug 12 12:22:58.967763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 329/647] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:58 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:59.009968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:59.011116 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:59.017463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:59.018153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:59.018955 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:59.020176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:59.020824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:59.021502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:59.180172 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:22:59.188189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7817a714-a599-461b-bb25-1fbe970a6bc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.182166 Aug 12 12:22:59.188796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 319/648] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:59 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:22:59.490729 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-7d09424a-1de6-4752-80ea-1dd45efb75ab req-032ee482-b59e-4108-8744-93d143dcabeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2cbb43-b41e-4e49-9529-e0f7db8b3079", "tag": "17af596b-a31a-4ac9-a3a4-e4bae611ce04"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:22:59.499224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-7d09424a-1de6-4752-80ea-1dd45efb75ab req-032ee482-b59e-4108-8744-93d143dcabeb service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:59.499935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-7d09424a-1de6-4752-80ea-1dd45efb75ab req-032ee482-b59e-4108-8744-93d143dcabeb service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:59.500432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-7d09424a-1de6-4752-80ea-1dd45efb75ab req-032ee482-b59e-4108-8744-93d143dcabeb service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:59.512585 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-7d09424a-1de6-4752-80ea-1dd45efb75ab req-032ee482-b59e-4108-8744-93d143dcabeb service nova] Creating event network-changed:17af596b-a31a-4ac9-a3a4-e4bae611ce04 for instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 on hv-cinder-79797 Aug 12 12:22:59.517922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-7d09424a-1de6-4752-80ea-1dd45efb75ab req-032ee482-b59e-4108-8744-93d143dcabeb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033588 Aug 12 12:22:59.519230 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 330/649] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:22:59.988244 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:22:59.988876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:22:59.994893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:59.995377 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:59.995990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:22:59.996871 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:22:59.997391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:22:59.997818 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:00.162836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:00.172061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4de469d6-ad47-4c72-862e-2d6b01126a25 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.187176 Aug 12 12:23:00.178396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 320/650] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:22:59 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:00.210285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:00.211060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:00.218523 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:00.219208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:00.220047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:00.220948 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:00.221408 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:00.221835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:00.371565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-1bc9b7ea-2708-43ab-9f90-479d41d3898d req-3d3253cb-a6cc-40ca-89fc-bf519ab5e35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836dc0f4-7d00-4730-9828-909cded7ec39", "name": "network-vif-plugged", "status": "completed", "tag": "30720ab8-0d22-48fe-b3f3-2941ca200322"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:00.382840 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1bc9b7ea-2708-43ab-9f90-479d41d3898d req-3d3253cb-a6cc-40ca-89fc-bf519ab5e35a service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:00.383408 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1bc9b7ea-2708-43ab-9f90-479d41d3898d req-3d3253cb-a6cc-40ca-89fc-bf519ab5e35a service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:00.383939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1bc9b7ea-2708-43ab-9f90-479d41d3898d req-3d3253cb-a6cc-40ca-89fc-bf519ab5e35a service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:00.402424 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-1bc9b7ea-2708-43ab-9f90-479d41d3898d req-3d3253cb-a6cc-40ca-89fc-bf519ab5e35a service nova] Creating event network-vif-plugged:30720ab8-0d22-48fe-b3f3-2941ca200322 for instance 836dc0f4-7d00-4730-9828-909cded7ec39 on hv-cinder-79797 Aug 12 12:23:00.403841 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-1bc9b7ea-2708-43ab-9f90-479d41d3898d req-3d3253cb-a6cc-40ca-89fc-bf519ab5e35a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037556 Aug 12 12:23:00.404860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 321/651] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:23:00.453904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:00.464049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d0c30c68-6ad5-47ff-b530-c6015a4ed799 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.258270 Aug 12 12:23:00.465553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 331/652] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:00 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:01.199158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:01.199949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:01.206058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:01.209004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:01.209004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:01.209004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:01.209004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:01.209414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:01.372522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:01.380413 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-69ed43a5-ca85-4f7f-9026-31f9ae86a1c1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.185760 Aug 12 12:23:01.381208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 322/653] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:01 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:01.489515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:01.490121 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:01.496903 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:01.497385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:01.497863 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:01.498538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:01.498987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:01.499453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:01.640726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:01.649341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-640a00eb-5713-46d9-9f08-87f6399a574d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.164383 Aug 12 12:23:01.649913 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 332/654] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:01 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:02.401597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:02.406680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:02.420094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:02.420590 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:02.421726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:02.422600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:02.423057 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:02.424833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:02.636857 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:02.648523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-59e9f143-b610-4f9d-bced-811becc7db38 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.250774 Aug 12 12:23:02.649214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 323/655] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:02 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:02.671963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:02.673329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:02.683541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:02.684579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:02.686241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:02.687555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:02.688258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:02.688907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:02.888993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:02.898203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7e0cc248-1479-48e1-be05-00f46851ede2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.230894 Aug 12 12:23:02.899223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 333/656] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:02 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:02.916785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:02.917529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:02.923968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:02.924755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:02.925439 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:02.927606 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:02.928350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:02.929067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:02.959953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3b45bf40-ca6d-4bab-a0ab-26d17bf21dbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/ips" status: 200 len: 149 microversion: 2.1 time: 0.060700 Aug 12 12:23:02.967000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 324/657] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:23:02 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/ips => generated 149 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:03.294795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:03.295373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:03.307231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:03.307805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:03.308320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:03.309125 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:03.310326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:03.310953 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:03.337632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0e476e66-84f0-4ecc-a8f1-5f83667de13f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/ips" status: 200 len: 152 microversion: 2.20 time: 0.046839 Aug 12 12:23:03.338336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 334/658] 10.222.0.27 () {60 vars in 1289 bytes} [Fri Aug 12 12:23:03 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:23:03.673096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:03.674106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:03.682200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:03.682767 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:03.683211 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:03.684188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:03.684669 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:03.685092 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:03.919740 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:03.921045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:03.933144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:03.933639 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:03.934079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:03.934780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:03.935231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:03.935649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:03.965629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:03.975991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0dfa537a-a044-447b-8363-742414fd4dff tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.308199 Aug 12 12:23:03.976603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 325/659] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:03 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:04.144297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:04.152488 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c5501a8a-59ec-4ece-91e2-335c3fd75a5f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.236925 Aug 12 12:23:04.153091 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 335/660] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:03 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:04.997452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:04.998019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:05.005616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:05.006324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:05.007049 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:05.008615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:05.008615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:05.009256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:05.164751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:05.173269 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-467c1d27-3bb1-415d-896e-0e440ed34389 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.179795 Aug 12 12:23:05.173839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 326/661] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:04 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:05.174590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:05.175222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:05.182684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:05.183164 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:05.183591 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:05.184314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:05.184829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:05.185243 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:05.383005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:05.391681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-caea204a-15b9-4502-848c-a17775af0b8c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.221013 Aug 12 12:23:05.392750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 336/662] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:05 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:05.913106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05fea730-1011-4d68-829d-02b01ece2712"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:05.915432 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:05.921356 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:05.921833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:05.922355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:05.923039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:05.923485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:05.923904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:06.106748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:06.107243 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:06.113152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:06.113635 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:06.114682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:06.115727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:06.116193 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:06.116624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:06.245800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:06.249778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lazy-loading 'services' on Instance uuid 9fc24be1-99ef-4bc5-8083-14917b3bb1cb {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:23:06.507437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4ebcf8d1-a805-42d3-bb8b-e8faf6b8cfe7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb/os-volume_attachments/7ce538f0-7595-445d-9ad1-fc14a5a97b0c" status: 202 len: 0 microversion: 2.1 time: 0.404412 Aug 12 12:23:06.508537 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 337/663] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:23:06 2022] DELETE /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb/os-volume_attachments/7ce538f0-7595-445d-9ad1-fc14a5a97b0c => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 12:23:06.514907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:06.516038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:06.529394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:06.530792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:06.531407 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:06.532306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:06.532956 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:06.533667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:06.679324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:06.686702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-71135e58-f4f3-4ae0-bd15-9b673a51e3f4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.176226 Aug 12 12:23:06.687274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 338/664] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:06 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:06.691655 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:06.692295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:06.697962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:06.701539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:06.701539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:06.701539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:06.701539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:06.701881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:06.891425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:06.891425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-28e93fcd-f5c0-47a2-919a-f9598347bbae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.171626 Aug 12 12:23:06.891425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 339/665] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:06 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:07.073526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:07.074048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:07.079933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:07.080448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:07.080913 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:07.081586 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:07.082036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:07.082507 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:07.116034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lazy-loading 'flavor' on Instance uuid 87e50626-b455-4357-8ab1-4ed9dea35297 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:23:08.044941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5eaffa52-52c0-418a-b81f-ade88104dd03 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/action" status: 202 len: 0 microversion: 2.20 time: 0.975175 Aug 12 12:23:08.049286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 340/666] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Aug 12 12:23:07 2022] POST /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/action => generated 0 bytes in 977 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 12 12:23:08.050781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:08.051465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:08.058146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:08.058554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:08.058984 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:08.059668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:08.060112 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:08.060527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:08.217683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:08.226493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a3808641-01ea-487b-b151-aa64f508f851 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.179610 Aug 12 12:23:08.227263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 341/667] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:08 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:08.239998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:08.239998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:08.239998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:08.239998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:08.240504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:08.240940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:08.241503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:08.241943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:08.378177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:08.386673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-170e1397-9c5d-4e97-9784-a1d79d71d00c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.158178 Aug 12 12:23:08.387261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 342/668] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:08 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:08.392433 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:08.393060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:08.399827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:08.400320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:08.400790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:08.401547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:08.401997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:08.402437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:08.782420 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:08.791428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:08.792954 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:08.794093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-565af143-c463-474c-9c7a-795da9808e7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.405920 Aug 12 12:23:08.794665 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 343/669] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:08 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:09.247140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:09.247817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:09.254185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:09.254663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:09.255150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:09.256002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:09.256457 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:09.256904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:09.392923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:09.397859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-54c9129e-d649-41ed-ba30-55584c7aa60b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.154443 Aug 12 12:23:09.398442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 344/670] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:09 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:09.409489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:09.410174 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:09.418805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:09.419387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:09.419917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:09.420721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:09.421315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:09.421819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:09.568878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:09.577123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-45d022c7-533d-452f-8279-e0e5d24e487c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.171830 Aug 12 12:23:09.578018 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 345/671] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:09 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:09.826084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:09.826084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:09.830034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:09.830601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:09.831101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:09.831855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:09.832389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:09.832839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:09.968349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:09.977301 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:09.978887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:09.980058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b1f89b41-c221-471a-80f2-325658fbc8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.164507 Aug 12 12:23:09.980962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 346/672] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:09 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:10.418947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:10.419573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:10.425804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:10.426279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:10.426716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:10.428115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:10.428561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:10.429004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:10.556555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:10.563865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-72f628a6-9de3-475d-bc7f-667969c81af1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.148715 Aug 12 12:23:10.573157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 347/673] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:10 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:10.597006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:10.597600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:10.603769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:10.604240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:10.604689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:10.605363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:10.605806 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:10.606224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:10.731257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:10.738488 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-01e3023b-0a68-42fd-84e3-7f706817b2f6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.145073 Aug 12 12:23:10.739045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 348/674] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:10 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:11.004185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:11.004724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:11.011277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:11.011751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:11.012180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:11.012877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:11.013324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:11.013740 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:11.139900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:11.148390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:11.149931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:11.151067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4839bbfd-7576-4bf8-a94f-7bae4b8028c0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.150841 Aug 12 12:23:11.151627 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 349/675] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:10 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:23:11.584749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:11.585384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:11.591758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:11.592241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:11.592714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:11.593401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:11.593862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:11.594289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:11.722878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:11.730348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8c5ee59c-79c9-4381-bdb7-119cbef29e9f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.149805 Aug 12 12:23:11.730918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 350/676] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:11 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:11.759349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:11.759950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:11.761788 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:11.766348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:11.766827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:11.767265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:11.767953 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:11.768407 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:11.768874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:11.916017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:11.919589 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:11.923920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9f0d88e4-9434-4c60-a87b-4676d2c1f44e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.168697 Aug 12 12:23:11.924486 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 351/677] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:11 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:12.174992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:12.175604 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:12.182753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:12.183374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:12.183814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:12.184504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:12.185032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:12.185456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:12.341109 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:12.349101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:12.351416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:12.352560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3cfd7b83-1ad3-4ada-acec-94c538413d73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.181842 Aug 12 12:23:12.353143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 352/678] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:12 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:23:12.751272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:12.764181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:12.764181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:12.764181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:12.764181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:12.764590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:12.764590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:12.764590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:12.901308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:12.908975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c56ac7d7-0b11-4005-8d92-83be8e12da9e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.161522 Aug 12 12:23:12.910853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 353/679] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:12 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:12.946432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:12.947031 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:12.952785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:12.953263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:12.953691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:12.954376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:12.954818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:12.955233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:13.082036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:13.089497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-da330c28-23c6-418a-855b-99148eb74143 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.147852 Aug 12 12:23:13.090059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 354/680] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:12 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:13.375131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:13.375714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:13.382145 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:13.382803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:13.383343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:13.384090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:13.384574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:13.385095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:13.525942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:13.535422 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:13.536885 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:13.540047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-eb5f1eaf-2813-4fc3-a075-9ee12a0ff52f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.168887 Aug 12 12:23:13.540626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 355/681] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:13 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:23:13.930662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:13.931374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:13.937710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:13.938195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:13.938642 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:13.939329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:13.939785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:13.940210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:14.075327 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:14.083059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6008429c-8fd1-4286-915f-62b5116e7d27 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.156546 Aug 12 12:23:14.083833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 356/682] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:13 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:14.110593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:14.111200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:14.117217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:14.117697 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:14.118128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:14.118811 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:14.119257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:14.119678 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:14.250492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:14.258056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-191b2d9d-1272-4c2d-a9ca-67fbad23441e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.151441 Aug 12 12:23:14.258617 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 357/683] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:14 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:14.564113 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:14.564732 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:14.570731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:14.571209 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:14.571637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:14.572307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:14.572778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:14.573194 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:14.705199 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:14.714284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:14.718077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:14.718077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-22ac6dc5-a353-4539-80a9-8b4548b865f0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.156728 Aug 12 12:23:14.718077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 358/684] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:14 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:23:15.103577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:15.104324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:15.122593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:15.123256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:15.123763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:15.124536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:15.125019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:15.125444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:15.257449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:15.264808 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ca087706-560b-49b8-850f-b154303964bd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.165428 Aug 12 12:23:15.265362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 359/685] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:15 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:15.278138 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:15.278738 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:15.284437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:15.284951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:15.285388 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:15.286577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:15.286577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:15.286945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:15.417272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:15.424534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e32508dd-6d53-4224-a6cb-8689e5ba6d20 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.150063 Aug 12 12:23:15.425122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 360/686] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:15 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:15.740195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:15.740855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:15.747579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:15.748051 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:15.748483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:15.749198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:15.749650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:15.750069 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:15.877917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:15.885767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:15.887270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:15.888406 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-87143cde-fc43-4ed5-a52f-7d59ae7a8c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.152262 Aug 12 12:23:15.889000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 361/687] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:15 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:23:15.919469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=57 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:16.000484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=92 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:16.285197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:16.285761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:16.292625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:16.293126 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:16.293554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:16.294253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:16.294698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:16.295123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:16.430510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:16.438147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c384480b-f179-4ac7-8562-ad3d8d7c7441 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.156848 Aug 12 12:23:16.438711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 362/688] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:16 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:16.446180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:16.446779 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:16.452819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:16.453778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:16.453778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:16.454406 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:16.454848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:16.455266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:16.599096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:16.609529 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7ed8b2a1-7873-4287-8151-61ee56d87168 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.167650 Aug 12 12:23:16.610122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 363/689] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:16 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:16.911362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:16.911963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:16.918217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:16.924821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:16.924821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:16.924821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:16.924821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:16.925216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:17.056471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:17.064333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:17.065867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:17.067018 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6e5535cf-961a-4711-abf4-6e5dbb2a27c8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.159573 Aug 12 12:23:17.067570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 364/690] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:16 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:23:17.459399 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:17.460008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:17.466922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:17.467409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:17.467833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:17.468513 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:17.468990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:17.469415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:17.597722 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:17.605888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7cd25d64-0d01-4844-93d1-3e068167f70c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.150454 Aug 12 12:23:17.606454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 365/691] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:17 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:17.630891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:17.631485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:17.637405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:17.637881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:17.638309 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:17.638987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:17.639437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:17.639852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:17.723481 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3bfc58c2-57f6-41de-bd32-721e8d42e473 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.814951 Aug 12 12:23:17.731080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 327/692] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:23:05 2022] POST /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments => generated 194 bytes in 11816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:17.772760 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:17.787816 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d730c6cb-b87a-4754-bfc8-cf8a95d37145 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.160419 Aug 12 12:23:17.788552 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 366/693] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:17 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:18.091285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:18.091991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:18.098207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:18.098692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:18.099134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:18.099825 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:18.100286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:18.100750 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:18.228625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:18.236809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:18.238333 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:18.239486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8c3c1229-bceb-428d-8a05-25b492b0d001 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.153633 Aug 12 12:23:18.240037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 328/694] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:18 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:18.625716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:18.626312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:18.632814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:18.634415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:18.634415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:18.634415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:18.634933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:18.635356 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:18.761506 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:18.768960 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2c9781e3-93b9-40da-9ffd-3acc6a171671 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.147026 Aug 12 12:23:18.769523 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 367/695] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:18 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:18.809876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:18.811396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:18.817479 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:18.818120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:18.818394 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:18.819088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:18.819542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:18.819970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:18.948782 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:18.956285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ef6184b5-8fb5-4375-abe8-5ce4ccff2eae tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.150470 Aug 12 12:23:18.956886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 329/696] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:18 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:19.262741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:19.263344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:19.269321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:19.269801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:19.270234 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:19.270908 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:19.271360 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:19.271780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:19.290567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:19.398674 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:19.406586 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:19.408083 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:19.409246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c3721762-6961-48b5-b97b-e47f64d64646 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.150423 Aug 12 12:23:19.409830 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 368/697] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:19 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:19.790311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:19.791245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:19.797768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:19.798255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:19.798689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:19.799376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:19.799829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:19.800253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:19.933242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:19.940581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-80738ced-9463-41e8-991e-e67c87580d2e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.155001 Aug 12 12:23:19.941183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 330/698] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:19 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:19.977162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:19.977789 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:19.984133 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:19.984603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:19.985063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:19.985729 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:19.986173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:19.986590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:20.111538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:20.119670 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5633367b-7398-4690-93c3-6facd0b1ad4d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.146323 Aug 12 12:23:20.122303 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 369/699] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:19 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:20.432196 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:20.432929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:20.439464 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:20.443144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:20.443144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:20.443144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:20.443144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:20.443494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:20.571298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:20.579295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:20.580838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:20.581978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ece02d61-932a-4f66-b798-73f3dec0f9d6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.154008 Aug 12 12:23:20.582538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 331/700] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:20 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:20.960841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:20.961448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:20.967360 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:20.967835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:20.968261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:20.968973 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:20.969419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:20.969835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:21.100283 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:21.108547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1941260f-4751-418a-b96f-a84307a8a48d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.151450 Aug 12 12:23:21.109141 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 370/701] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:20 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:21.140916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:21.141528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:21.147857 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:21.148336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:21.149315 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:21.149995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:21.150446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:21.150869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:21.279844 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:21.287089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8eb036ff-f04a-49e6-ba3d-f446439207f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.150084 Aug 12 12:23:21.287648 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 332/702] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:21 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:21.605892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:21.606495 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:21.612420 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:21.612939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:21.613374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:21.614059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:21.614508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:21.614930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:21.743325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:21.751786 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:21.753354 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:21.754497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d63cd6ac-f336-40ef-b6ad-2738eaf4a4b0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.153098 Aug 12 12:23:21.755045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 371/703] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:21 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:22.130779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:22.131407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:22.137372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:22.137849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:22.138282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:22.138962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:22.139411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:22.139832 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:22.270194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:22.278214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1aa4e222-ff3a-4905-99dc-64b11bfe2072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.151297 Aug 12 12:23:22.278823 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 333/704] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:22 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:22.308221 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:22.308893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:22.315462 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:22.315946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:22.316382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:22.317092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:22.317593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:22.318016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:22.449413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:22.457761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d6c67660-5f66-4b3e-9fd2-2bfbccae1f87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.153700 Aug 12 12:23:22.458321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 372/705] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:22 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:22.777217 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:22.777725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:22.783672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:22.784152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:22.784589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:22.785324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:22.785780 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:22.786205 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:22.918019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:22.926156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:22.930926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:22.930926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0fc42e9d-1235-49c6-be3a-a42dfc00270d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.155746 Aug 12 12:23:22.930926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 334/706] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:22 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:23.298564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:23.299176 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:23.306200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:23.306681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:23.307110 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:23.307784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:23.308236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:23.308828 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:23.444946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:23.452315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4fdb8f20-8760-4977-a75e-3a16341640a3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.157633 Aug 12 12:23:23.452907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 373/707] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:23 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:23.478736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:23.479350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:23.485785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:23.486272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:23.486708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:23.487390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:23.487838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:23.488261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:23.617761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:23.625561 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-aa4afc97-7c14-492d-8bac-80c1280db020 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.151499 Aug 12 12:23:23.626115 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 335/708] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:23 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:23.953343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:23.953945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:23.959940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:23.960415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:23.960893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:23.962176 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:23.962766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:23.963188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:24.093662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:24.105684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:24.107345 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:24.108598 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-da651d80-47aa-4428-b987-dbb499d8a317 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.159770 Aug 12 12:23:24.109264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 374/709] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:23 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:24.473588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:24.474190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:24.480254 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:24.480881 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:24.481187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:24.481883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:24.482332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:24.482755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:24.629629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:24.637574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-57bf9dbf-7172-4dc9-befd-a0e9b4170cb4 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.167822 Aug 12 12:23:24.638143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 336/710] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:24 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:24.647083 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:24.647695 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:24.656101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:24.656618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:24.657157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:24.657849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:24.658305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:24.659034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:24.821750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:24.829860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-90fac04a-4960-48f1-88df-4e68afaaa702 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.187371 Aug 12 12:23:24.830442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 375/711] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:24 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:25.132419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:25.133053 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:25.139386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:25.139876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:25.140317 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:25.141065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:25.141527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:25.141954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:25.269814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:25.277981 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:25.279486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:25.280635 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1a280b3c-19f6-4802-bc40-d75e5f15ed9e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.152342 Aug 12 12:23:25.281212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 337/712] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:25 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:25.659025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:25.659645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:25.666270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:25.666751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:25.667188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:25.667876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:25.668329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:25.669031 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:25.793967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:25.801392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0dd5baaf-e3b6-4959-830a-78036bb38072 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.146125 Aug 12 12:23:25.801954 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 376/713] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:25 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:25.851391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:25.852046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:25.858515 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:25.858992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:25.859433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:25.860115 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:25.860668 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:25.861093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:25.989298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:25.997182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-da9b9187-2d13-4a71-a75e-c462e4ea0dc7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.149703 Aug 12 12:23:25.997738 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 338/714] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:25 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:26.304001 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:26.304608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:26.311292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:26.311769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:26.312200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:26.312911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:26.313360 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:26.313775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:26.442600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:26.450458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:26.451896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:26.453060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-935b8907-52df-41de-a145-7c91a4ca9f6e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.152907 Aug 12 12:23:26.453640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 377/715] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:26 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:26.823562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:26.824167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:26.830651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:26.831182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:26.831619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:26.832310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:26.832918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:26.833347 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:26.965441 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:26.973028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5160ced5-8124-422c-a562-ef6d685d8aa0 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.154538 Aug 12 12:23:26.973592 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 339/716] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:26 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:27.018180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:27.018813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:27.025967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:27.026440 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:27.027120 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:27.028002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:27.028448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:27.028894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:27.157775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:27.165361 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1282e961-baa7-43be-a5b0-8b393bffa81c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.150890 Aug 12 12:23:27.165843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 378/717] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:27 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:27.475234 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:27.475863 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:27.482107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:27.482585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:27.483059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:27.483847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:27.484292 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:27.484740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:27.611501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:27.620130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:27.621660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:27.622800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-06d80b3d-c6ff-44d4-ba46-5933eff6fed4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.151392 Aug 12 12:23:27.623355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 340/718] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:27 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:27.993165 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:27.993836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:27.999800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:28.000276 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:28.000731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:28.001404 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:28.001852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:28.002269 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:28.133772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:28.141701 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7c913d20-859d-416c-8f63-6b71a9cf46ae tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1372 microversion: 2.1 time: 0.152159 Aug 12 12:23:28.142272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 379/719] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:27 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:28.186188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:28.186800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:28.193236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:28.193722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:28.194157 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:28.194838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:28.195285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:28.195708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:28.327433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:28.334794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-15c53636-9abb-4874-bc69-1c241ecbc149 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.152492 Aug 12 12:23:28.335337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 341/720] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:28 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:28.645857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:28.646375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:28.652222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:28.652742 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:28.653182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:28.653862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:28.654313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:28.654737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:28.784261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:28.792702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:28.794208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:28.795349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8499177f-6193-4d08-8109-50c84b622037 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.153527 Aug 12 12:23:28.795911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 380/721] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:28 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:29.163044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:29.163648 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:29.170618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.171098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.171528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.172258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.172727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.173146 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.301094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:29.309616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-946bfd4c-5acb-448e-90b0-5c6195470689 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1565 microversion: 2.1 time: 0.150450 Aug 12 12:23:29.310191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 342/722] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:29 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:29.329958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:29.330487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:29.336569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.337067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.337583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.338280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.338728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.339148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.356000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:29.356423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:29.362573 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.363058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.363490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.364281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.364769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.365191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.369740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:29.451093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ad037ba5-49a5-47fe-a753-449a767d6d62 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124891 Aug 12 12:23:29.451695 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 381/723] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 12 12:23:29 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:29.520114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:29.529647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-73acada9-c24f-412f-90c2-c126f9a3b460 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.178081 Aug 12 12:23:29.541222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 343/724] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:29 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:29.818538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:29.819147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:29.825815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.826301 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.826734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.827428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.827888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.828306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.950758 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:29.951267 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:29.957792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.960015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.960015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.960015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:29.960015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:29.960426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:29.995049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:29.995155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:23:30.002308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:30.003802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:30.004994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7b37cfb4-9fa1-4e0d-b4cb-ab218ce39b35 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.190218 Aug 12 12:23:30.005714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 382/725] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:29 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:30.299466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b8692385-7cb7-441b-a1c2-c3d0f2896564 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 204 len: 0 microversion: 2.1 time: 0.352970 Aug 12 12:23:30.300137 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 344/726] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:23:29 2022] DELETE /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:23:30.309493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:30.310253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:30.316619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:30.317198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:30.317696 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:30.318479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:30.318920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:30.319337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:30.462261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:30.496350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-73d8df42-112d-4875-a173-ef81e3a92b07 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1558 microversion: 2.1 time: 0.191560 Aug 12 12:23:30.497305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 383/727] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:30 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:30.516331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-11639627-1b53-401a-9e5a-3af078ba805f req-46b0bf62-4104-454f-b1bf-7d592cc9518b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836dc0f4-7d00-4730-9828-909cded7ec39", "tag": "30720ab8-0d22-48fe-b3f3-2941ca200322"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:30.526225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-11639627-1b53-401a-9e5a-3af078ba805f req-46b0bf62-4104-454f-b1bf-7d592cc9518b service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:30.526711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-11639627-1b53-401a-9e5a-3af078ba805f req-46b0bf62-4104-454f-b1bf-7d592cc9518b service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:30.527144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-11639627-1b53-401a-9e5a-3af078ba805f req-46b0bf62-4104-454f-b1bf-7d592cc9518b service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:30.538433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-11639627-1b53-401a-9e5a-3af078ba805f req-46b0bf62-4104-454f-b1bf-7d592cc9518b service nova] Creating event network-changed:30720ab8-0d22-48fe-b3f3-2941ca200322 for instance 836dc0f4-7d00-4730-9828-909cded7ec39 on hv-cinder-79797 Aug 12 12:23:30.545023 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-11639627-1b53-401a-9e5a-3af078ba805f req-46b0bf62-4104-454f-b1bf-7d592cc9518b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032859 Aug 12 12:23:30.545628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 345/728] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:30.555915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:30.557220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:30.563963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:30.564449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:30.564975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:30.565706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:30.566338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:30.566767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:30.697504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:30.705413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-40564b26-8682-40a3-a911-efad36c0cdb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.153522 Aug 12 12:23:30.706105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 384/729] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:30 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:31.028883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:31.029699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:31.035826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:31.036317 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:31.036791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:31.037484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:31.037942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:31.038366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:31.174086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:31.185149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:31.185149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:31.185567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-00323ab9-f1b5-42b5-804c-b802c9926d67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.160839 Aug 12 12:23:31.186099 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 346/730] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:31 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:31.518130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:31.518825 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:31.525912 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:31.526605 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:31.527397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:31.528087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:31.528547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:31.529036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:31.561925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:31.676996 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:31.685074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8f841730-6b0b-466a-9251-cec136980232 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1558 microversion: 2.1 time: 0.170816 Aug 12 12:23:31.685636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 385/731] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:31 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:31.727368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:31.727978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:31.735437 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:31.735904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:31.736343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:31.737073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:31.737532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:31.737960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:31.865831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:31.873318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-db205a09-8859-4dcf-b81e-70eb46ce1f68 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.150117 Aug 12 12:23:31.873880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 347/732] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:31 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:32.209390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:32.209992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:32.216012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:32.216489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:32.216950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:32.217628 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:32.218075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:32.218494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:32.347543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:32.355548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:32.357086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:32.358236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b0ad8b6d-3e28-4791-a5b0-f137ed810814 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.153100 Aug 12 12:23:32.358785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 386/733] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:32 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:32.705827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:32.706420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:32.712381 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:32.712895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:32.713907 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:32.714607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:32.715058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:32.715493 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:32.850778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:32.858737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fb5f87e6-af74-4778-95fb-145d6687c19d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1558 microversion: 2.1 time: 0.156813 Aug 12 12:23:32.859306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 348/734] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:32 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:32.894037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:32.894646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:32.901652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:32.905115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:32.905115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:32.905115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:32.905115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:32.905460 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:33.033135 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:33.040448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8ea9d9cd-c70c-48e0-b449-b77c9c8cc694 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.150471 Aug 12 12:23:33.041033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 387/735] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:32 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:33.382005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:33.382764 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:33.389586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:33.390073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:33.390504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:33.391193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:33.391639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:33.392055 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:33.529770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:33.537732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:33.539427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:33.540564 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d87a9feb-9175-4cd1-a3a8-f669aee200ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.162804 Aug 12 12:23:33.541152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 349/736] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:33 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:33.879429 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:33.880029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:33.885968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:33.886442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:33.886904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:33.887559 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:33.888007 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:33.888425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:34.017642 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:34.025223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-88ea0a62-c2e5-4e30-b06e-331db9459c88 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1512 microversion: 2.1 time: 0.149623 Aug 12 12:23:34.026284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 388/737] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:33 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:34.062036 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:34.062613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:34.069254 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:34.069735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:34.070239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:34.070923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:34.071372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:34.071791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:34.202738 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:34.210161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6733a1a1-8124-451f-a4d5-a9fa155ed5ac tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.152019 Aug 12 12:23:34.210714 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 350/738] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:34 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:34.564237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:34.565492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:34.570915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:34.571333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:34.571759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:34.572441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:34.573142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:34.578154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:34.700768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:34.709376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:34.710742 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:34.711881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f5d45606-04ed-41ac-80df-6bc282045071 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.151585 Aug 12 12:23:34.712453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 389/739] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:34 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:35.046735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:35.047450 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:35.053927 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:35.054407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:35.054838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:35.055581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:35.056034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:35.056456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:35.190794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:35.200152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f4fc1796-d344-4a7f-9e5a-7d1459066713 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1512 microversion: 2.1 time: 0.157534 Aug 12 12:23:35.201095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 351/740] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:35 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:35.231805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:35.232492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:35.252662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:35.253143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:35.253577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:35.254274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:35.254728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:35.255144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:35.398460 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:35.406281 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d9f5961d-c6cd-4274-a8b0-4620ecda74ab tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.178883 Aug 12 12:23:35.406867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 390/741] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:35 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:35.735604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:35.736213 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:35.742288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:35.742777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:35.743212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:35.743904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:35.744357 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:35.745355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:35.888425 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:35.896631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:35.898220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:35.899386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7a3d979b-725f-40e0-862a-f5e99ddd0bc9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.167604 Aug 12 12:23:35.899936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 352/742] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:35 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:36.220937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:36.221461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:36.227572 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:36.228049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:36.228476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:36.229878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:36.230426 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:36.237381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:36.359178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:36.366911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-274df064-62be-4cdb-85e4-892cb5c60381 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1512 microversion: 2.1 time: 0.149883 Aug 12 12:23:36.367564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 391/743] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:36 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:36.437591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:36.438178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:36.449396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:36.449892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:36.450331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:36.451055 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:36.451474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:36.453369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:36.695825 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-05270b90-941d-4a67-8de4-6d3066eee825 req-9645a787-587c-49f0-a1af-90ded7482f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2cbb43-b41e-4e49-9529-e0f7db8b3079", "name": "network-vif-plugged", "status": "completed", "tag": "17af596b-a31a-4ac9-a3a4-e4bae611ce04"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:36.708686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-05270b90-941d-4a67-8de4-6d3066eee825 req-9645a787-587c-49f0-a1af-90ded7482f78 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:36.709290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-05270b90-941d-4a67-8de4-6d3066eee825 req-9645a787-587c-49f0-a1af-90ded7482f78 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:36.709785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-05270b90-941d-4a67-8de4-6d3066eee825 req-9645a787-587c-49f0-a1af-90ded7482f78 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:36.721992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-05270b90-941d-4a67-8de4-6d3066eee825 req-9645a787-587c-49f0-a1af-90ded7482f78 service nova] Creating event network-vif-plugged:17af596b-a31a-4ac9-a3a4-e4bae611ce04 for instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 on hv-cinder-79797 Aug 12 12:23:36.727480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-05270b90-941d-4a67-8de4-6d3066eee825 req-9645a787-587c-49f0-a1af-90ded7482f78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Aug 12 12:23:36.728551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 392/744] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:23:36.902534 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:36.910221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-90175143-a92b-4dc9-9a04-2cc2fd90c21c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.476594 Aug 12 12:23:36.910784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 353/745] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:36 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:36.925765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:36.926480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:36.932735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:36.933236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:36.933670 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:36.934365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:36.934972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:36.935387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:37.068850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:37.075850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:37.077387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:37.078597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ef3ac206-30c9-4d43-ad8c-ad9b8982f723 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.158643 Aug 12 12:23:37.079188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 393/746] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:36 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:37.398653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:37.399422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:37.420670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:37.425542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:37.425542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:37.425542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:37.425542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:37.425906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:37.601105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:37.621816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-30329c66-36c5-40ad-95b3-f7f111290770 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1512 microversion: 2.1 time: 0.235823 Aug 12 12:23:37.622704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 354/747] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:37 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:37.668994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-144f0457-9468-464e-a555-f3775a7c1519 req-cd463399-ff82-4166-bf83-9fe48950cdef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc24be1-99ef-4bc5-8083-14917b3bb1cb", "name": "network-vif-deleted", "tag": "e566ff8f-b7d6-4402-a62d-6bc8bf9e6eb1"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:37.685268 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-144f0457-9468-464e-a555-f3775a7c1519 req-cd463399-ff82-4166-bf83-9fe48950cdef service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:37.685755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-144f0457-9468-464e-a555-f3775a7c1519 req-cd463399-ff82-4166-bf83-9fe48950cdef service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:37.686495 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-144f0457-9468-464e-a555-f3775a7c1519 req-cd463399-ff82-4166-bf83-9fe48950cdef service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:37.699638 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-144f0457-9468-464e-a555-f3775a7c1519 req-cd463399-ff82-4166-bf83-9fe48950cdef service nova] Creating event network-vif-deleted:e566ff8f-b7d6-4402-a62d-6bc8bf9e6eb1 for instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb on hv-cinder-79797 Aug 12 12:23:37.704947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-144f0457-9468-464e-a555-f3775a7c1519 req-cd463399-ff82-4166-bf83-9fe48950cdef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039916 Aug 12 12:23:37.705552 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 394/748] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:37.931419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:37.932027 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:37.939490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:37.940214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:37.940824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:37.941661 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:37.942259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:37.954230 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:38.045854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7cc5fdc7-27f5-4ab9-b6a7-86de2bf171f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: .version_select at 0x7f990ee7c160>, body: {"keypair": {"name": "tempest-keypair-2118254632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLrxVRhjyeYSh3cUtd6bmZV4OiipnAfCncpzuedd3RfhQxqosgJB97PGGfrirxlZfhbslDSMyRWCT8cB0kaWDDeHIJmZA8P0pqNa6Fghr4Tjvr6mNe2ckhOcw88IXi5sg=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:38.061944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-7cc5fdc7-27f5-4ab9-b6a7-86de2bf171f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:23:38.065773 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-7cc5fdc7-27f5-4ab9-b6a7-86de2bf171f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for user 0156c689e109489d9265dd3dd4d5cfde and project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:23:38.094646 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:38.102246 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2299e4ed-edbb-423d-bb37-f05c890590d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.174892 Aug 12 12:23:38.102903 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 355/749] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:37 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:38.108031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:38.108627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:38.114288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:38.114762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:38.115189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:38.115864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:38.116367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:38.116883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:38.372222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:38.372222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:38.372508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:38.372508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-52f624d9-a176-4315-b631-2292381e75ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.173888 Aug 12 12:23:38.372508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 356/750] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:38 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:38.644207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:38.644899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:38.651929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:38.652898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:38.653348 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:38.654061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:38.654514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:38.654935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:38.723227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:38.730849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2d53d9a6-e7ac-4c35-a816-2a0452b00984 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1303 microversion: 2.1 time: 0.091247 Aug 12 12:23:38.731412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 357/751] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:38 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:38.784915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7cc5fdc7-27f5-4ab9-b6a7-86de2bf171f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.744416 Aug 12 12:23:38.785624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 395/752] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:23:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:23:39.124111 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:39.124757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:39.130853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:39.131339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:39.131770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:39.132451 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:39.132927 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:39.133346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:39.295847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:39.301573 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:39.306435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a51f541e-2046-4502-8165-c01450de2e9f tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.186996 Aug 12 12:23:39.307011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 358/753] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:39 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:39.393815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:39.394622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:39.397154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:39.404304 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:39.405050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:39.408608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:39.408608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:39.408608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:39.408608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:39.603249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:39.611914 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:39.613449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:39.614837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-861597ef-1b2d-4227-baff-004e15b62f2d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.225073 Aug 12 12:23:39.615400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 396/754] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:39 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:39.752476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:39.753113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:39.759779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:39.760261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:39.760722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:39.761478 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:39.761926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:39.762353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:39.795316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:39.795809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:39.796279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:39.799801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lazy-loading 'fault' on Instance uuid 9fc24be1-99ef-4bc5-8083-14917b3bb1cb {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:23:39.854168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:39.862362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bd26da90-d58f-4045-a849-10fb88d17db1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1308 microversion: 2.1 time: 0.114160 Aug 12 12:23:39.863091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 359/755] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:39 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:40.329739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:40.330470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:40.337719 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:40.338483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:40.339084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:40.340298 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:40.340944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:40.341397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:40.579898 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:40.590538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-642bc450-b8f2-47b4-b926-bbae89e29842 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1359 microversion: 2.1 time: 0.266102 Aug 12 12:23:40.595700 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 397/756] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:40 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:40.639501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:40.640623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:40.650345 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:40.651667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:40.652991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:40.653887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:40.654506 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:40.655092 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:40.826403 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:40.834460 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:40.835984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:40.837307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-48fca9dc-3a33-4f78-8470-42d35ca3614c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.202752 Aug 12 12:23:40.837862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 360/757] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:40 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:40.887071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:40.893946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:40.905744 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:40.907090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:40.908491 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:40.910409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:40.912037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:40.915556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:40.971263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:40.972410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:40.972891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:40.973357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lazy-loading 'fault' on Instance uuid 9fc24be1-99ef-4bc5-8083-14917b3bb1cb {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:23:41.030890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:41.039399 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-04ddf636-28c7-404b-a3ef-9868d337381b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 200 len: 1308 microversion: 2.1 time: 0.159099 Aug 12 12:23:41.053257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 398/758] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:40 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:41.626857 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:41.627474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:41.637742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:41.638512 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:41.639690 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:41.640764 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:41.642932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:41.643489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:41.724681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-326467847", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ab29f31-7915-471c-8e03-8b38ddd1a049"}], "security_groups": [{"name": "tempest-securitygroup--941973015"}], "key_name": "tempest-keypair-2118254632", "user_data": "}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:41.910804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] validate_networks() for [('9ab29f31-7915-471c-8e03-8b38ddd1a049', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:23:41.915370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:41.924305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b1921496-e9de-49d5-9161-629cc9916f3c tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1549 microversion: 2.1 time: 0.311042 Aug 12 12:23:41.937498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 361/759] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:41 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1549 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:41.944369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:41.945058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:41.951407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:41.951806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:41.952241 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:41.952982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:41.953436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:41.953859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.157891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:42.166402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:42.168851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:42.170467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-291f399a-fd82-4aa8-9426-f272161c6216 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.231487 Aug 12 12:23:42.187216 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 362/760] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:41 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:42.192329 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:42.193282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:42.199708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.200428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.200896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.201598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.202204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.202796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.422830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:42.430937 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-15a0e1d7-0a68-4950-8d67-e6a96078c587 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1549 microversion: 2.1 time: 0.242330 Aug 12 12:23:42.431860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 363/761] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:42 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1549 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:42.453419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:42.454385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 9fc24be1-99ef-4bc5-8083-14917b3bb1cb] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:42.462067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.462880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.468453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.468453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.468453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.468453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.483853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] HTTP exception thrown: Instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb could not be found. Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Request method failure captured: Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb HTTP/1.1 Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kXA8y5oznvIFe6-kCxRIdZJ72GvfwizN0QA1PH1Lb5k1z-T_Jv7ZYZrsKcAa9B6LyzysTtCMsv55LVKTf91ePOgaP-PG0qXZF6s4saE-6TbJXLKD1SjcNud1kiAyE_cZFm1XygGvK2OGNt25pM413ig1FzFwNfECqOr0RJ4AN3z3Jo Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: f1b3e4986e72478bb46a86e1e9e3355c Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1574389223 Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:23:42.485572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b3e4986e72478bb46a86e1e9e3355c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b3e4986e72478bb46a86e1e9e3355c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b3e4986e72478bb46a86e1e9e3355c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b3e4986e72478bb46a86e1e9e3355c"}]}] Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesSnapshotTestJSON-1574389223 Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: f1b3e4986e72478bb46a86e1e9e3355c Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1574389223 Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesSnapshotTestJSON-1574389223-project Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 07db808b777b4407ac05f3f0fa2394f8 Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesSnapshotTestJSON-1574389223-project Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb could not be found. Aug 12 12:23:42.486853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '9fc24be1-99ef-4bc5-8083-14917b3bb1cb'} Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb could not be found. Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:23:42.488279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb could not be found. Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb could not be found. Aug 12 12:23:42.501225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:23:42.502287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Returning 404 to user: Instance 9fc24be1-99ef-4bc5-8083-14917b3bb1cb could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:23:42.502287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bfea18a7-2074-4707-90ba-41ca67ec70ea tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb" status: 404 len: 111 microversion: 2.1 time: 0.040641 Aug 12 12:23:42.502287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 364/762] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:42 2022] GET /compute/v2.1/servers/9fc24be1-99ef-4bc5-8083-14917b3bb1cb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:23:42.502287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:42.502582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:42.502582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Searching by: {'deleted': False, 'project_id': '478411e9884545398aa7fbec4279a57b'} {{(pid=121153) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 12 12:23:42.513291 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.513930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.514387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.515268 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.515917 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.516543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.584146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:23:42.584568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:23:42.585686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:23:42.586105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:23:42.586515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:23:42.601154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.601658 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.602090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.602824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.603286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.603709 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.628782 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.multi_cell_list [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121153) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 12 12:23:42.637969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:23:42.644382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for user 0156c689e109489d9265dd3dd4d5cfde and project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:23:42.661128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:23:42.666085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:23:42.735586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7bc1b240-1b2e-4717-8d40-77c0eab323d5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.244354 Aug 12 12:23:42.736176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 365/763] 10.222.0.27 () {58 vars in 1125 bytes} [Fri Aug 12 12:23:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:42.749077 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:42.749687 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:42.755721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.756213 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.756669 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.757387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:42.757838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:42.758263 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:42.854859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c3f7fc5b-39ee-4c04-aa46-4e27ceeb10eb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.134461 Aug 12 12:23:42.859583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 399/764] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:23:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 12:23:42.871907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-540f5040-3ee9-40ef-9302-141dd191cba0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:42.872525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-540f5040-3ee9-40ef-9302-141dd191cba0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:42.980031 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-540f5040-3ee9-40ef-9302-141dd191cba0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:43.003878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-540f5040-3ee9-40ef-9302-141dd191cba0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1241 microversion: 2.1 time: 0.139422 Aug 12 12:23:43.030169 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 400/765] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:42 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1241 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:43.066343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:43.076437 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5489e895-c9d8-4d9f-b692-20c9f6cbff71 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1549 microversion: 2.1 time: 0.331389 Aug 12 12:23:43.082105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 366/766] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:42 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1549 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:43.099178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-9f3ab221-dc36-4344-9961-6c77a4af1835 req-f226a283-fb04-4ce1-8e73-44550cfb5dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e50626-b455-4357-8ab1-4ed9dea35297", "name": "network-vif-plugged", "status": "completed", "tag": "ea96cc24-3c69-42d6-a3cc-6f2a132e8057"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:43.133576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-9f3ab221-dc36-4344-9961-6c77a4af1835 req-f226a283-fb04-4ce1-8e73-44550cfb5dc5 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:43.137027 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-9f3ab221-dc36-4344-9961-6c77a4af1835 req-f226a283-fb04-4ce1-8e73-44550cfb5dc5 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:43.137864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-9f3ab221-dc36-4344-9961-6c77a4af1835 req-f226a283-fb04-4ce1-8e73-44550cfb5dc5 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:43.156918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-9f3ab221-dc36-4344-9961-6c77a4af1835 req-f226a283-fb04-4ce1-8e73-44550cfb5dc5 service nova] Creating event network-vif-plugged:ea96cc24-3c69-42d6-a3cc-6f2a132e8057 for instance 87e50626-b455-4357-8ab1-4ed9dea35297 on hv-cinder-79797 Aug 12 12:23:43.163479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-9f3ab221-dc36-4344-9961-6c77a4af1835 req-f226a283-fb04-4ce1-8e73-44550cfb5dc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067784 Aug 12 12:23:43.164504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 401/767] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:43.194282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:43.197291 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:43.202029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:43.202589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:43.203148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:43.203940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:43.204455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:43.204964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:43.378059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:43.390196 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:43.392463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:43.394153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2018a4b9-1468-46ca-a46d-8f20343ce286 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.204426 Aug 12 12:23:43.395029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 367/768] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:43 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:44.037731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:44.038446 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:44.045957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:44.051554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:44.052024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:44.052809 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:44.053274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:44.053698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:44.141007 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:44.155376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-360991c7-cb1e-49d9-a0ab-945805a4d1b1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1245 microversion: 2.1 time: 0.123320 Aug 12 12:23:44.157746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 402/769] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:44 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:44.416926 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:44.417678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:44.425537 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:44.426083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:44.426517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:44.427209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:44.427656 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:44.428076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:44.572866 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:44.582314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:44.583820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:44.585005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e4ab8188-f170-4e74-b945-5b86c8836639 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.171997 Aug 12 12:23:44.585702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 368/770] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:44 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:45.178168 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:45.178778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:45.185863 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:45.186345 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:45.186774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:45.187463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:45.187907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:45.188325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:45.257649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:45.266629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-95a8b4a8-bc35-4712-99dd-012d689d886f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1237 microversion: 2.1 time: 0.092293 Aug 12 12:23:45.267199 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 403/771] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:45 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:45.608389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:45.609057 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:45.615977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:45.616461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:45.616916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:45.617599 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:45.618041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:45.622996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:45.874033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:45.882066 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:45.883541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:45.884692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-999f83af-a9f1-460a-9475-4bfb1e59bac3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.281060 Aug 12 12:23:45.885245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 369/772] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:45 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:46.287477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:46.288082 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:46.295095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:46.295834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:46.296265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:46.297029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:46.297474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:46.297892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:46.365062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:46.372891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e31f5bba-1b99-4f9c-b205-72abc0a55c7f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1237 microversion: 2.1 time: 0.089153 Aug 12 12:23:46.385834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 404/773] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:46 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:46.908238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:46.908801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:46.911261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:46.915853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:46.917193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:46.917629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:46.918425 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:46.919711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:46.920138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:47.395186 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:47.396978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:47.413737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:47.415928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:47.416467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:47.417717 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:47.421854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:47.422823 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:47.497578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:47.510522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:47.514263 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:47.516430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-58fd3b44-936b-4166-b0da-03ba76e6c231 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.612417 Aug 12 12:23:47.532630 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 370/774] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:46 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:47.590868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:47.614486 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8e4b7255-3e0e-4178-bbee-ae2dbd2c4c01 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1237 microversion: 2.1 time: 0.223681 Aug 12 12:23:47.621321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 405/775] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:47 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1237 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:48.541266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:48.541866 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:48.550221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:48.551579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:48.552497 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:48.553868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:48.560119 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:48.560119 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:48.641050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:48.642413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:48.670099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:48.671048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:48.672066 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:48.672215 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:48.672982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:48.673582 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:48.704334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:48.723024 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:48.733666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:48.734603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:48.735988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ffa1ee22-ea26-48b5-92ae-b750da3020c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.198796 Aug 12 12:23:48.736548 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 371/776] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:48 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:48.839991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:48.848625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c6dc3d38-5deb-460b-857a-e3e8a8cd50ca tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1237 microversion: 2.1 time: 0.213142 Aug 12 12:23:48.849310 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 406/777] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:48 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:49.761736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:49.764426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:49.770916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:49.771405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:49.771836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:49.772800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:49.773426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:49.773979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:49.871010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:49.872896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:49.883551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:49.884560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:49.885175 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:49.886044 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:49.886735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:49.887314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:50.008527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:50.018137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4b4f4f7e-c6f8-4969-a946-7e3d59013ac6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1237 microversion: 2.1 time: 0.151486 Aug 12 12:23:50.019030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 407/778] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:49 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:50.027970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:50.036691 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:50.038319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:50.042162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4ef8fae3-b7a7-47ab-b723-0c621e144759 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.283549 Aug 12 12:23:50.042162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 372/779] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:49 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:51.039820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:51.044266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:51.048183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:51.049364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:51.049800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:51.050594 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:51.051054 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:51.051477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:51.129207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:51.138794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e083a22d-3766-45ce-ba8d-f9a30c6a11ce tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1301 microversion: 2.1 time: 0.102565 Aug 12 12:23:51.139438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 373/780] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:51 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:51.144505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:51.145165 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:51.152802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:51.153584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:51.154071 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:51.154781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:51.155186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:51.155611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:51.164684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-be73f032-279e-40ab-97a8-e93449b1258f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Action: 'create', calling method: .version_select at 0x7f990ee48af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-185830658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeM5COD24H7XzaD2LyayXKlnv9WTjnzjntvQZ96Fx/vfmh+9PuGRtePfOS0B+VgW8yNNx4XfRQcyK6yinMpdg+v4iN0C3n5SuYBD4FBd65Kwn73SiTbxlQNj4kUG2ba4A=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:51.187412 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-be73f032-279e-40ab-97a8-e93449b1258f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Getting quotas for project b20b2b17c8794507a7cd8fecfb50e13b. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:23:51.193846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-be73f032-279e-40ab-97a8-e93449b1258f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Getting quotas for user 803cf2e2fb664442ae8b0f8919a90aec and project b20b2b17c8794507a7cd8fecfb50e13b. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:23:51.305308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-be73f032-279e-40ab-97a8-e93449b1258f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.313377 Aug 12 12:23:51.306359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 408/781] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:23:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:51.350460 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:51.363212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:51.364890 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:51.366290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1078409c-49d2-4f64-96d0-49460c67753d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.225542 Aug 12 12:23:51.394622 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 374/782] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:51 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:51.695263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e1f87d1-6d47-4b8d-8333-ed32d5853c21"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:51.697579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:51.705311 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:51.706563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:51.706563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:51.706980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:51.707427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:51.707848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:52.160284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:52.161647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:52.170011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:52.170711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:52.174261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:52.174261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:52.174261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:52.174261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:52.201497 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:52.337067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:52.354435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-838753e9-25d0-4b6c-af68-200320852905 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.197745 Aug 12 12:23:52.369341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 375/783] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:52 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:52.400500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:52.401328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:52.408232 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:52.408814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:52.410193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:52.411147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:52.411791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:52.412407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:52.562240 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:52.576542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:52.578591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:52.580071 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cda18c9e-9a59-4ad3-9641-55b089e45de9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1746 microversion: 2.20 time: 0.183505 Aug 12 12:23:52.594203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 376/784] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:52 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1746 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:23:52.626024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:52.671800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-04c7d437-1537-4607-8f93-a71c0127bfe0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "POST /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980549 Aug 12 12:23:52.672525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 409/785] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:23:51 2022] POST /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:53.298304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:23:53.305397 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-9d2f44a4-8db3-4eb0-bbb3-79ca8d71e819 req-b4527e2c-5ae9-4cf6-b769-8b27cad683b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb10d887-ad82-4cbc-a00f-5fe01c3150b6", "tag": "8bf117fa-5b48-4608-9f3b-6d85c18200b4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:53.322565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-9d2f44a4-8db3-4eb0-bbb3-79ca8d71e819 req-b4527e2c-5ae9-4cf6-b769-8b27cad683b4 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:53.323144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-9d2f44a4-8db3-4eb0-bbb3-79ca8d71e819 req-b4527e2c-5ae9-4cf6-b769-8b27cad683b4 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:53.323680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-9d2f44a4-8db3-4eb0-bbb3-79ca8d71e819 req-b4527e2c-5ae9-4cf6-b769-8b27cad683b4 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:53.344899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-9d2f44a4-8db3-4eb0-bbb3-79ca8d71e819 req-b4527e2c-5ae9-4cf6-b769-8b27cad683b4 service nova] Creating event network-changed:8bf117fa-5b48-4608-9f3b-6d85c18200b4 for instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 on hv-cinder-79797 Aug 12 12:23:53.352276 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-9d2f44a4-8db3-4eb0-bbb3-79ca8d71e819 req-b4527e2c-5ae9-4cf6-b769-8b27cad683b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058775 Aug 12 12:23:53.357707 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 377/786] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:23:53.382831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:53.383578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:53.391315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:53.392157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:53.392968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:53.398873 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:53.398873 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:53.398873 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:53.606235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:53.607836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:53.620968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:53.629469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:53.629469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:53.629469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:53.629469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:53.629862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:53.678158 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:53.688981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6d96cbbd-57c5-455f-9365-7fdfe529595f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.315028 Aug 12 12:23:53.701349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 410/787] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:53 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:53.875584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:53.901900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:53.906129 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:53.908214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7a97b88a-fa43-4015-8811-afea728eef67 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.306540 Aug 12 12:23:53.909028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 378/788] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:53 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:54.795849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:54.795849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:54.795849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:54.795849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:54.796714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:54.796714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:54.796714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:54.796714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:54.916004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:54.917613 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3a25ad75-aed5-46ee-aeb5-304644f1a463 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.208171 Aug 12 12:23:54.918653 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 411/789] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:54 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:54.939227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:54.941010 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:54.954322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:54.956402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:54.957141 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:54.958398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:54.965996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:54.967277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:55.131323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:55.147728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:55.151228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:55.156398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1d0759b0-2c4e-468b-95bd-383ccf37bad4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.225708 Aug 12 12:23:55.157176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 379/790] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:54 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:55.944512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:55.945811 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:55.956392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:55.957190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:55.957777 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:55.959349 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:55.959967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:55.960393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:56.148508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:56.159652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-048788e8-2bc8-4d88-a65a-d40257b4672c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.219617 Aug 12 12:23:56.160454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 412/791] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:55 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:56.184526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:56.186319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:56.193294 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:56.194806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:56.195935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:56.197089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:56.198138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:56.198768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:56.394545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:56.411461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:56.418896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:56.422013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2a359167-95ef-429d-9376-faf9a47467c4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.242018 Aug 12 12:23:56.423869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 380/792] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:56 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:57.181056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:57.181675 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:57.189394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:57.190021 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:57.190533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:57.191335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:57.192041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:57.192404 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:57.354749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:57.362555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-450826a7-3424-4ef5-994a-890847ab292b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.185421 Aug 12 12:23:57.363217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 413/793] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:57 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:57.453729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:57.461224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:57.462700 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:57.463385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:57.463990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:57.464897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:57.465525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:57.466107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:57.613476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:57.623826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:57.627256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:57.628704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a07747a2-099b-463e-a38a-ece3ade6f460 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.181369 Aug 12 12:23:57.642188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 381/794] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:57 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:58.383717 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:58.384432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:58.391748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:58.392103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:58.392540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:58.393257 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:58.393704 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:58.394121 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:58.543004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:58.553475 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4daa6137-1a7a-4228-9741-139f10f393ac tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.173500 Aug 12 12:23:58.564684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 414/795] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:58 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:23:58.654415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:58.654415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:58.664325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:58.664844 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:58.665284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:58.666135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:58.666588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:58.667011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:58.859900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1806477506", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "networks": [{"uuid": "e854be93-724c-4f27-a3be-35ae1178b4d2"}]}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:23:58.914157 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:58.924582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:58.926451 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:58.927670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-75916cd6-981c-4e4e-a63b-b41f19252287 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.278886 Aug 12 12:23:58.928829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 382/796] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:58 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:23:59.574750 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:59.575666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:59.582161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:59.582786 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:59.583258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:59.583957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:59.584411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:59.584870 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:59.846615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:23:59.857682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-35a3298f-964e-4fd2-b787-02db9e02a5c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.286586 Aug 12 12:23:59.858456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 383/797] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:23:59 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:23:59.955428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:23:59.956745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:23:59.963148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:59.963706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:59.964210 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:23:59.964997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:23:59.965515 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:23:59.966151 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:00.118700 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:00.129417 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:00.131726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:00.133742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ca9eb06-7b56-4451-aebd-cbd538239c8b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.182952 Aug 12 12:24:00.140710 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 384/798] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:23:59 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:00.879756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:00.880461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:00.887120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:00.887675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:00.888145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:00.888860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:00.889323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:00.889820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:01.037685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:01.046020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-756aa085-6da1-4e21-ba32-9f95ccb40945 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.170077 Aug 12 12:24:01.046624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 385/799] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:00 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:01.159985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:01.165744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:01.167104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:01.167589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:01.168028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:01.168751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:01.169209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:01.169638 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:01.204976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=16 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:01.312708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:01.328731 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:01.330224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:01.335532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a74f8b6e-06a0-437f-a2a9-84e0813cf6b3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.180542 Aug 12 12:24:01.348947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 386/800] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:01 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:02.068045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:02.068724 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:02.077042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:02.077593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:02.078098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:02.079422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:02.080006 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:02.080723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:02.222589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:02.230507 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d5b7a9f2-bced-4010-95e6-3313a83435da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.166785 Aug 12 12:24:02.231068 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 387/801] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:02 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:02.360094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:02.360437 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:02.376255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:02.376939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:02.377456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:02.378334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:02.378801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:02.379244 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:02.573511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:02.583140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:02.584841 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:02.585875 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c6fa6a7a-6ee7-440f-ab9b-5a525766e46a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.230225 Aug 12 12:24:02.603078 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 388/802] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:02 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:03.251610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:03.252277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:03.258642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:03.259118 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:03.259545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:03.260226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:03.260689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:03.261105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:03.413754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:03.424407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a1181269-2ef4-4c31-88a8-4eeec6a1087d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.176970 Aug 12 12:24:03.429324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 389/803] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:03 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:03.615789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:03.616461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:03.625578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:03.626144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:03.626586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:03.627287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:03.627740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:03.628165 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:03.795189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:03.808174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:03.809757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:03.810930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d636209f-439b-48cc-a0fa-caf8c801196f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.204500 Aug 12 12:24:03.812268 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 390/804] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:03 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:04.449188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:04.449864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:04.459861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:04.460351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:04.460820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:04.461535 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:04.462005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:04.462419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:04.631884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:04.631884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cd0c0731-40d1-4bd5-ba63-450b64d070ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.177133 Aug 12 12:24:04.631884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 391/805] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:04 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:04.744721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:04.745335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:04.751400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:04.751881 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:04.752316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:04.753322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:04.753490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:04.753913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:04.901797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:04.903673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:04.913626 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5b4d6798-3915-4617-a8ca-ed5a47711c84 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1595 microversion: 2.1 time: 0.172532 Aug 12 12:24:04.914436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 392/806] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:04 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1595 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:04.927640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:04.928245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:04.934900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:04.935461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:04.935967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:04.936815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:04.937620 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:04.937804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:05.080559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:05.088982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:05.090684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:05.091839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d727b68f-e93c-4be9-9fd2-594be83eed70 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.168348 Aug 12 12:24:05.096732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 393/807] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:04 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:05.097889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-d03f2ec6-3a71-4e66-9f5d-34bb6b67ef6a req-2ddb2495-bea4-41e2-b60f-45fce7f95079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10d887-ad82-4cbc-a00f-5fe01c3150b6", "name": "network-vif-plugged", "status": "completed", "tag": "8bf117fa-5b48-4608-9f3b-6d85c18200b4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:05.108316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d03f2ec6-3a71-4e66-9f5d-34bb6b67ef6a req-2ddb2495-bea4-41e2-b60f-45fce7f95079 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:05.110005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d03f2ec6-3a71-4e66-9f5d-34bb6b67ef6a req-2ddb2495-bea4-41e2-b60f-45fce7f95079 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:05.110446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d03f2ec6-3a71-4e66-9f5d-34bb6b67ef6a req-2ddb2495-bea4-41e2-b60f-45fce7f95079 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:05.122181 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-d03f2ec6-3a71-4e66-9f5d-34bb6b67ef6a req-2ddb2495-bea4-41e2-b60f-45fce7f95079 service nova] Creating event network-vif-plugged:8bf117fa-5b48-4608-9f3b-6d85c18200b4 for instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 on hv-cinder-79797 Aug 12 12:24:05.129033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-d03f2ec6-3a71-4e66-9f5d-34bb6b67ef6a req-2ddb2495-bea4-41e2-b60f-45fce7f95079 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034593 Aug 12 12:24:05.131096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 394/808] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:24:05.794694 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:05.799632 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:05.802810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:05.803504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:05.804095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:05.804989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:05.805592 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:05.806169 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:06.066758 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:06.074328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2602a716-4586-459d-b8f5-da43ee9112c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.426258 Aug 12 12:24:06.074994 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 395/809] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:05 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:06.226944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:06.232727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:06.233485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:06.234052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:06.234485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:06.235176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:06.235631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:06.236057 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:06.396156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:06.405167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:06.407937 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:06.409148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a125aaee-34bb-4bf1-83b9-a197c252207a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.297333 Aug 12 12:24:06.409722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 396/810] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:06 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:06.494662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] validate_networks() for [('e854be93-724c-4f27-a3be-35ae1178b4d2', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:24:07.095320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:07.095927 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:07.115958 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:07.116455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:07.116924 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:07.117628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:07.118104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:07.118526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:07.425435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:24:07.425858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:24:07.426367 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:24:07.426809 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:24:07.427579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:24:07.436850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:07.437378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:07.437812 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:07.438567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:07.439017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:07.439442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:07.445805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:07.453888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-29884f5a-71ef-4a49-90bd-a8ac12ae529d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.362241 Aug 12 12:24:07.454772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 397/811] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:07 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:07.459526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Getting quotas for project f1b3e4986e72478bb46a86e1e9e3355c. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:24:07.463611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Getting quotas for user 07db808b777b4407ac05f3f0fa2394f8 and project f1b3e4986e72478bb46a86e1e9e3355c. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:24:07.469742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:07.470581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:07.476179 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:24:07.477820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:07.478365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:07.478648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:24:07.479082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:07.479844 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:07.480367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:07.480883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:07.627720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7b30cfcd-e293-4415-b33f-3417a063f3cb tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.778987 Aug 12 12:24:07.634801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 415/812] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:23:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 8786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 12:24:07.642762 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1589053d-a951-4903-a0b3-4fd59c0370d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:07.643770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1589053d-a951-4903-a0b3-4fd59c0370d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:07.728205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1589053d-a951-4903-a0b3-4fd59c0370d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:07.731207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:07.740674 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1589053d-a951-4903-a0b3-4fd59c0370d7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1219 microversion: 2.1 time: 0.102752 Aug 12 12:24:07.742310 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 416/813] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:07 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:07.743382 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:07.745029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:07.746185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e765adda-1c89-4424-9b02-6e8bf3b8688c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.290230 Aug 12 12:24:07.746928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 398/814] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:07 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:07.841952 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-adb1ccee-40b1-4a6f-8f3a-398a77173329 req-c4c8dbc7-51b9-42d6-9e64-5bfa6330afd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2cbb43-b41e-4e49-9529-e0f7db8b3079", "tag": "17af596b-a31a-4ac9-a3a4-e4bae611ce04"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:07.865361 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-adb1ccee-40b1-4a6f-8f3a-398a77173329 req-c4c8dbc7-51b9-42d6-9e64-5bfa6330afd3 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:07.865839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-adb1ccee-40b1-4a6f-8f3a-398a77173329 req-c4c8dbc7-51b9-42d6-9e64-5bfa6330afd3 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:07.866639 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-adb1ccee-40b1-4a6f-8f3a-398a77173329 req-c4c8dbc7-51b9-42d6-9e64-5bfa6330afd3 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:07.896462 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-adb1ccee-40b1-4a6f-8f3a-398a77173329 req-c4c8dbc7-51b9-42d6-9e64-5bfa6330afd3 service nova] Creating event network-changed:17af596b-a31a-4ac9-a3a4-e4bae611ce04 for instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 on hv-cinder-79797 Aug 12 12:24:07.901930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-adb1ccee-40b1-4a6f-8f3a-398a77173329 req-c4c8dbc7-51b9-42d6-9e64-5bfa6330afd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064053 Aug 12 12:24:07.902849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 417/815] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:24:08.476328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:08.477028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:08.491149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:08.491977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:08.492431 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:08.493212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:08.493666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:08.494086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:08.664303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:08.675538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fa7ae522-8463-45e6-9b6d-9450818cfe5e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1366 microversion: 2.1 time: 0.200289 Aug 12 12:24:08.675538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 399/816] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:08 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:08.763136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:08.769406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:08.770627 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:08.771176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:08.790328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:08.790823 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:08.791265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:08.792094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:08.792719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:08.793207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:08.812584 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:08.813209 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:08.813846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:08.814732 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:08.815344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:08.815924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:08.914228 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:08.921977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ba49f235-b0f7-41b1-81ba-0fef4e758989 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1223 microversion: 2.1 time: 0.163131 Aug 12 12:24:08.922778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 418/817] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:08 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:08.986521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:08.994994 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:08.996489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:08.997722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-66e68558-e558-44af-9719-3dc883452c59 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1741 microversion: 2.20 time: 0.232762 Aug 12 12:24:08.998284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 400/818] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:08 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1741 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:09.695949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:09.696840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:09.705630 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:09.706416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:09.707110 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:09.707895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:09.708425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:09.708960 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:09.944427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:09.945759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:09.952548 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:09.953234 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:09.953929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:09.954746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:09.955381 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:09.955992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:09.962619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:09.976191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8dddbe1c-8145-48f8-ae54-1d3cae3484be tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1556 microversion: 2.1 time: 0.285874 Aug 12 12:24:09.977435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 419/819] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:09 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1556 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:10.014969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:10.014969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:10.021244 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:10.021974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:10.022531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:10.023447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:10.023987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:10.024575 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:10.060048 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:10.071272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b6f4d75c-7881-4312-92bb-11d8399e6a17 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1223 microversion: 2.1 time: 0.131434 Aug 12 12:24:10.082949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 401/820] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:09 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:10.087950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:10.088803 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:10.096135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:10.096925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:10.097363 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:10.098054 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:10.098502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:10.098980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:10.135171 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8b652af0-5e65-4506-8d0c-563f77a8a700 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134103 Aug 12 12:24:10.140005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 420/821] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 12 12:24:09 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:24:10.372575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:10.382171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:10.383678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:10.385200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ce9137d1-9dbe-404b-8ded-450474b01441 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1723 microversion: 2.20 time: 0.308688 Aug 12 12:24:10.385762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 402/822] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:10 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:10.935643 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1387200846"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:10.936176 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:10.938800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:10.943728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:10.954004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:10.954004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:10.954004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:10.954004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:10.954796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.085342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.network.security_group_api [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Adding security group af45a014-a1ee-4e2d-aae7-84ef383324fe to port 17af596b-a31a-4ac9-a3a4-e4bae611ce04 Aug 12 12:24:11.094527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:11.095407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:11.102428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:11.102992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:11.103485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.104282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:11.104826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:11.105311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.188535 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:11.196831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3f341ef5-475f-4e34-935c-879ab3a82aa2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1279 microversion: 2.1 time: 0.107806 Aug 12 12:24:11.198308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 403/823] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:11 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:11.408175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:11.408904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:11.414789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:11.415262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:11.415879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.416752 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:11.417355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:11.417779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.502451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e05d30e5-d657-4c9f-8402-200ab28d9438 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "POST /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/action" status: 202 len: 0 microversion: 2.1 time: 0.571115 Aug 12 12:24:11.506822 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 421/824] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:24:10 2022] POST /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:24:11.511861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:11.512624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:11.519744 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:11.520228 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:11.520733 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.521601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:11.522401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:11.523005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.675478 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:11.683214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:11.684757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:11.685952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c8d29110-b651-4ed6-90e2-14a829a7fc3a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1723 microversion: 2.20 time: 0.282305 Aug 12 12:24:11.687221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 404/825] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:11 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:11.693071 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-4f3cebf8-2803-496b-aa60-68bfe2919afd req-5b08017c-456f-4083-b4d7-e7441901b7ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2cbb43-b41e-4e49-9529-e0f7db8b3079", "tag": "17af596b-a31a-4ac9-a3a4-e4bae611ce04"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:11.704294 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4f3cebf8-2803-496b-aa60-68bfe2919afd req-5b08017c-456f-4083-b4d7-e7441901b7ae service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:11.704860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4f3cebf8-2803-496b-aa60-68bfe2919afd req-5b08017c-456f-4083-b4d7-e7441901b7ae service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:11.705301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4f3cebf8-2803-496b-aa60-68bfe2919afd req-5b08017c-456f-4083-b4d7-e7441901b7ae service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.718509 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-4f3cebf8-2803-496b-aa60-68bfe2919afd req-5b08017c-456f-4083-b4d7-e7441901b7ae service nova] Creating event network-changed:17af596b-a31a-4ac9-a3a4-e4bae611ce04 for instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 on hv-cinder-79797 Aug 12 12:24:11.723992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-4f3cebf8-2803-496b-aa60-68bfe2919afd req-5b08017c-456f-4083-b4d7-e7441901b7ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034559 Aug 12 12:24:11.724582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 405/826] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:24:11.729920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-b47a9e8d-2089-4ff5-9b25-fdc190c5c71a req-ffe712cb-2042-42fe-ba3f-58f9470f430d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb10d887-ad82-4cbc-a00f-5fe01c3150b6", "tag": "8bf117fa-5b48-4608-9f3b-6d85c18200b4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:11.731038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:11.740522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-136474b1-11eb-4f02-8d82-753099b16cf2 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1642 microversion: 2.1 time: 0.232404 Aug 12 12:24:11.740740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b47a9e8d-2089-4ff5-9b25-fdc190c5c71a req-ffe712cb-2042-42fe-ba3f-58f9470f430d service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:11.741113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b47a9e8d-2089-4ff5-9b25-fdc190c5c71a req-ffe712cb-2042-42fe-ba3f-58f9470f430d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:11.741246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 422/827] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:11 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1642 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:11.741807 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b47a9e8d-2089-4ff5-9b25-fdc190c5c71a req-ffe712cb-2042-42fe-ba3f-58f9470f430d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:11.753410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-b47a9e8d-2089-4ff5-9b25-fdc190c5c71a req-ffe712cb-2042-42fe-ba3f-58f9470f430d service nova] Creating event network-changed:8bf117fa-5b48-4608-9f3b-6d85c18200b4 for instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 on hv-cinder-79797 Aug 12 12:24:11.758843 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-b47a9e8d-2089-4ff5-9b25-fdc190c5c71a req-ffe712cb-2042-42fe-ba3f-58f9470f430d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032815 Aug 12 12:24:11.759432 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 406/828] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:24:12.218173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:12.218770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:12.229329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:12.230100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:12.230792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:12.231955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:12.232754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:12.233246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:12.299187 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:12.306915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-570fa172-ea48-42c8-b6ec-855f5bf2d774 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1279 microversion: 2.1 time: 0.092626 Aug 12 12:24:12.307493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 423/829] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:12 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:12.710106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:12.710804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:12.716826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:12.717308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:12.717744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:12.718428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:12.718879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:12.719469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:12.862795 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:12.871394 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:12.872870 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:12.874093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-232314d9-4b3a-4b82-883a-2834e3b531dd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1723 microversion: 2.20 time: 0.168732 Aug 12 12:24:12.889326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 407/830] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:12 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:13.327537 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:13.328238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:13.335976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:13.336469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:13.336993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:13.337706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:13.338162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:13.338591 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:13.636306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-da6a5f47-a3ff-40e8-a4b2-8a9a8f9c6375 req-2fb26fa5-6424-4537-9345-e6dcfc096376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e50626-b455-4357-8ab1-4ed9dea35297", "name": "network-vif-unplugged", "status": "completed", "tag": "ea96cc24-3c69-42d6-a3cc-6f2a132e8057"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:13.647250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-da6a5f47-a3ff-40e8-a4b2-8a9a8f9c6375 req-2fb26fa5-6424-4537-9345-e6dcfc096376 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:13.647851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-da6a5f47-a3ff-40e8-a4b2-8a9a8f9c6375 req-2fb26fa5-6424-4537-9345-e6dcfc096376 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:13.648304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-da6a5f47-a3ff-40e8-a4b2-8a9a8f9c6375 req-2fb26fa5-6424-4537-9345-e6dcfc096376 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:13.661046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-da6a5f47-a3ff-40e8-a4b2-8a9a8f9c6375 req-2fb26fa5-6424-4537-9345-e6dcfc096376 service nova] Creating event network-vif-unplugged:ea96cc24-3c69-42d6-a3cc-6f2a132e8057 for instance 87e50626-b455-4357-8ab1-4ed9dea35297 on hv-cinder-79797 Aug 12 12:24:13.664214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-da6a5f47-a3ff-40e8-a4b2-8a9a8f9c6375 req-2fb26fa5-6424-4537-9345-e6dcfc096376 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031930 Aug 12 12:24:13.664838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 408/831] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:24:13.707096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:13.714562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-82a7ccfe-a47d-4034-a087-269ce0b52427 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1289 microversion: 2.1 time: 0.390931 Aug 12 12:24:13.727909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 424/832] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:13 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1289 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:13.898749 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:13.899438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:13.905729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:13.906440 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:13.906895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:13.907743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:13.908188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:13.908797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:14.104369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:14.113373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:14.114894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:14.116052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-77439a32-4841-41a8-99e8-28d2131bbb7f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1726 microversion: 2.20 time: 0.222305 Aug 12 12:24:14.116837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 409/833] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:13 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:14.139076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c624a930-c67e-40be-9679-e1eaeb2e113d"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:14.146650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:14.147885 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:14.148374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:14.148847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:14.149547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:14.150002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:14.150428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:14.226645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:14.740203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:14.740770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:14.746759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:14.747242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:14.747686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:14.748400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:14.748879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:14.749308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:14.940559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:14.947949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6a07e467-98fa-4dbb-b326-d2dd24228089 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.211707 Aug 12 12:24:14.948511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 410/834] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:14 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:15.113215 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-42cb0766-ce38-49df-81c7-7f8bb355cefd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.978075 Aug 12 12:24:15.113853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 425/835] 10.222.0.27 () {62 vars in 1364 bytes} [Fri Aug 12 12:24:14 2022] POST /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments => generated 188 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:24:15.237855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:15.238445 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:15.244541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:15.245050 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:15.245794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:15.246479 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:15.246974 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:15.247392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:15.335958 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121153) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 12:24:15.429768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:15.529995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-ec2506f0-bd69-4b13-9bb0-aa78723a2116 req-2065db04-4cb3-4f5b-a9c9-c2c91e5c651a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e74f6c-69a9-41ae-a546-7c2ae724731f", "tag": "b8aeabd8-d907-449f-aee7-11888e4170e4"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:15.541301 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ec2506f0-bd69-4b13-9bb0-aa78723a2116 req-2065db04-4cb3-4f5b-a9c9-c2c91e5c651a service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:15.541796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ec2506f0-bd69-4b13-9bb0-aa78723a2116 req-2065db04-4cb3-4f5b-a9c9-c2c91e5c651a service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:15.542218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ec2506f0-bd69-4b13-9bb0-aa78723a2116 req-2065db04-4cb3-4f5b-a9c9-c2c91e5c651a service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:15.553686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-ec2506f0-bd69-4b13-9bb0-aa78723a2116 req-2065db04-4cb3-4f5b-a9c9-c2c91e5c651a service nova] Creating event network-changed:b8aeabd8-d907-449f-aee7-11888e4170e4 for instance 91e74f6c-69a9-41ae-a546-7c2ae724731f on hv-cinder-79797 Aug 12 12:24:15.558912 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-ec2506f0-bd69-4b13-9bb0-aa78723a2116 req-2065db04-4cb3-4f5b-a9c9-c2c91e5c651a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 Aug 12 12:24:15.559943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 426/836] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:24:15.589822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-540f42bd-27b5-4010-8135-490035709273 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/action" status: 202 len: 0 microversion: 2.20 time: 0.355908 Aug 12 12:24:15.593787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 411/837] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Aug 12 12:24:15 2022] POST /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:24:15.599182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:15.599874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:15.605991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:15.606463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:15.606888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:15.607618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:15.609259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:15.609259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:15.835504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:15.845222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:15.847152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:15.848414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b30a7487-4f24-4a52-91ea-673d5af1333e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1752 microversion: 2.20 time: 0.253549 Aug 12 12:24:15.849059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 427/838] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:15 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1752 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:15.969895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:15.970501 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:15.976536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:15.977047 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:15.977485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:15.978167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:15.978620 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:15.979025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:16.146541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:16.155532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f977ae33-8a02-4494-b31c-3946bb47dcc1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.190028 Aug 12 12:24:16.162159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 412/839] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:15 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:16.871741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:16.872346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:16.879182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:16.879668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:16.880160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:16.881824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:16.881824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:16.883134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:17.012681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:17.021442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:17.022958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:17.024107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b9ede42e-471a-45da-9b53-243b6024f1d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1752 microversion: 2.20 time: 0.156237 Aug 12 12:24:17.024691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 428/840] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:16 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:17.182327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:17.182925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:17.185679 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:17.191349 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:17.191824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:17.192249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:17.193000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:17.193466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:17.193863 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:17.335726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:17.343516 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d03c9790-218f-443c-9175-e245ee5b8a6b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.164995 Aug 12 12:24:17.344156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 413/841] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:17 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:18.046799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:18.047357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:18.049453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:18.050219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=8 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:18.055538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:18.056016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:18.063574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:18.063574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:18.063574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:18.063574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:18.188047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:18.196893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:18.198402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:18.199548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-aec192af-58bb-4164-9743-a854d65d9bad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1752 microversion: 2.20 time: 0.156732 Aug 12 12:24:18.200111 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 429/842] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:18 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:18.421494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:18.422102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:18.428965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:18.429447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:18.429879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:18.430555 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:18.431005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:18.431426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:18.563085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:18.571443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-821b580d-78f5-448d-8420-4d99824af891 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.153790 Aug 12 12:24:18.571953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 414/843] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:18 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:19.223208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:19.223746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:19.230233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:19.230713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:19.231164 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:19.231835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:19.232287 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:19.232738 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:19.362926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:19.371208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:19.372727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:19.373872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f9ffa4e0-141a-4e3d-af45-607ca9be5d47 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1752 microversion: 2.20 time: 0.154619 Aug 12 12:24:19.374424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 430/844] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:19 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:19.592210 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:19.592770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:19.599108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:19.599605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:19.600038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:19.600735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:19.601184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:19.601599 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:19.726723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:19.734044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-04b4d9f8-997a-4fd0-8532-577074059d5e tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.145780 Aug 12 12:24:19.734596 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 415/845] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:19 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:20.397814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:20.398416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:20.404822 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:20.405302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:20.405733 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:20.406414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:20.406862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:20.407280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:20.538307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:20.546626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:20.548875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:20.550128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-98007fee-3aff-48cb-a6d6-a0813b41a2bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1752 microversion: 2.20 time: 0.156269 Aug 12 12:24:20.550689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 431/846] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:20 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:20.755192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:20.755733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:20.762145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:20.762619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:20.763047 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:20.763720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:20.764166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:20.764586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:20.892819 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:20.900318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0b680203-0449-4a42-8e48-f696b3be2332 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.149012 Aug 12 12:24:20.901217 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 416/847] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:20 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:21.572982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:21.573610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:21.580378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:21.580837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:21.581269 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:21.582459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:21.582918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:21.583340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:21.715235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:21.724177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:21.725697 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:21.726828 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6e5b6de1-1e08-4a59-8049-1f123dfb5eea tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1752 microversion: 2.20 time: 0.157785 Aug 12 12:24:21.727378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 432/848] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:21 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:21.922032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:21.922642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:21.929670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:21.930150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:21.931979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:21.931979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:21.931979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:21.932289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:22.061167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:22.069091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b7a9d57f-a0e4-44c3-9e11-8e8a6c20e725 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.150943 Aug 12 12:24:22.069659 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 417/849] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:21 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:22.749517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:22.750108 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:22.756147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:22.756620 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:22.757074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:22.757751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:22.758193 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:22.758610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:22.888871 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:22.897258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:22.898743 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:22.899876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-41bac494-106d-488a-a016-538275af6be9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1752 microversion: 2.20 time: 0.154246 Aug 12 12:24:22.900422 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 433/850] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:22 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:23.090527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:23.091167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:23.098150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:23.098629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:23.099067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:23.099804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:23.100254 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:23.100734 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:23.233975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:23.243301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3051e2dd-78c4-4bf7-9e54-e3f6aa09c555 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.156715 Aug 12 12:24:23.244320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 418/851] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:23 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:23.922158 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:23.922900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:23.930152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:23.930631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:23.931066 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:23.931757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:23.932205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:23.932624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:24.060246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:24.069479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:24.070976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:24.072112 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9a09e016-10cd-4baa-8e3c-7cdfa20be274 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1754 microversion: 2.20 time: 0.153877 Aug 12 12:24:24.072748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 434/852] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:23 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:24.264135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:24.264825 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:24.271466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:24.271953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:24.272393 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:24.273104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:24.273561 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:24.273984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:24.405471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:24.413503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1888de8e-0150-4277-bb1a-1c1b7ee01cd6 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.153281 Aug 12 12:24:24.414067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 419/853] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:24 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:25.095455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:25.096791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:25.103231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:25.103707 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:25.104159 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:25.104855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:25.105303 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:25.105716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:25.236514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:25.245025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:25.246530 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:25.247669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-973d019e-0dc5-47c2-8d13-0ef6c054b795 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.156162 Aug 12 12:24:25.248223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 435/854] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:25 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:25.434737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:25.435381 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:25.442975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:25.443459 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:25.443891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:25.444577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:25.445048 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:25.445744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:25.658128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:25.665577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-17779502-36f1-4f4b-a776-9652961997f1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.234690 Aug 12 12:24:25.666159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 420/855] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:25 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:25.989034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-e43db655-8358-4038-8fbf-6b3271097bf8 req-8c778dfe-79d6-4cd4-ab11-58443c22ff58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e74f6c-69a9-41ae-a546-7c2ae724731f", "name": "network-vif-plugged", "status": "completed", "tag": "b8aeabd8-d907-449f-aee7-11888e4170e4"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:25.998854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-e43db655-8358-4038-8fbf-6b3271097bf8 req-8c778dfe-79d6-4cd4-ab11-58443c22ff58 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:25.999577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-e43db655-8358-4038-8fbf-6b3271097bf8 req-8c778dfe-79d6-4cd4-ab11-58443c22ff58 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:26.000170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-e43db655-8358-4038-8fbf-6b3271097bf8 req-8c778dfe-79d6-4cd4-ab11-58443c22ff58 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:26.011851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-e43db655-8358-4038-8fbf-6b3271097bf8 req-8c778dfe-79d6-4cd4-ab11-58443c22ff58 service nova] Creating event network-vif-plugged:b8aeabd8-d907-449f-aee7-11888e4170e4 for instance 91e74f6c-69a9-41ae-a546-7c2ae724731f on hv-cinder-79797 Aug 12 12:24:26.016939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-e43db655-8358-4038-8fbf-6b3271097bf8 req-8c778dfe-79d6-4cd4-ab11-58443c22ff58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Aug 12 12:24:26.018155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 436/856] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:24:26.270354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:26.270951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:26.279193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:26.279678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:26.280107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:26.281272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:26.282093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:26.282816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:26.430657 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:26.439816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:26.441472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:26.442841 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-01cb7a63-af3a-4ed7-8d81-3dbc62c0d185 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.176609 Aug 12 12:24:26.443402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 421/857] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:26 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:26.688073 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:26.688792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:26.696715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:26.697231 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:26.697668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:26.698362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:26.698820 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:26.699247 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:26.883766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:26.895236 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-951bfb54-3c1d-4247-8b71-02ffb9468df8 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.211965 Aug 12 12:24:26.895821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 437/858] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:26 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:27.470224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:27.470826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:27.477519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:27.478001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:27.478441 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:27.479162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:27.479666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:27.480000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:27.613522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:27.622735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:27.624256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:27.625779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-af9f7ea3-b735-459b-bdce-42dcc2100039 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.159631 Aug 12 12:24:27.626343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 422/859] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:27 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:27.917287 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:27.917896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:27.925219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:27.925711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:27.926250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:27.926956 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:27.927417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:27.927844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:28.062482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:28.070244 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b5fd7038-0195-4776-8696-774fefe27019 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.156781 Aug 12 12:24:28.074621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 438/860] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:27 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:28.327143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1388578370", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-185830658", "security_groups": [{"name": "tempest-secgroup-smoke-520541081"}], "networks": [{"uuid": "b22f9e74-3df6-4a57-b5ae-e6e8873ea93e"}], "block_device_mapping_v2": [{"uuid": "99ff346a-64bb-4a67-909b-f75d8469cda6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:28.439648 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] validate_networks() for [('b22f9e74-3df6-4a57-b5ae-e6e8873ea93e', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:24:28.649761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:28.650493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:28.656575 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:28.657759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:28.658266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:28.659671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:28.660205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:28.660754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:28.875477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:28.887106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:28.889264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:28.890789 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9d7bdd0c-9578-4657-b860-84e63fef7d2f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.245029 Aug 12 12:24:28.891540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 439/861] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:28 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:28.909186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:24:28.909748 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:24:28.910104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:24:28.910528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:24:28.910932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:24:28.920433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:28.921249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:28.922042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:28.922948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:28.923699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:28.924518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:28.949155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Getting quotas for project b20b2b17c8794507a7cd8fecfb50e13b. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:24:28.953287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Getting quotas for user 803cf2e2fb664442ae8b0f8919a90aec and project b20b2b17c8794507a7cd8fecfb50e13b. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:24:29.010724 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:24:29.012911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99ff346a-64bb-4a67-909b-f75d8469cda6',volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:24:29.091027 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:29.091771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:29.098615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:29.099100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:29.099541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:29.100229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:29.100711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:29.101142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:29.415617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6dc904df-b0da-42ba-999e-2d1563aba4b0 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.094357 Aug 12 12:24:29.417019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 423/862] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:24:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:24:29.431666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-06e6a863-16f0-422e-895d-29d6cd05a9ed tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:29.432401 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-06e6a863-16f0-422e-895d-29d6cd05a9ed tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:29.493999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-06e6a863-16f0-422e-895d-29d6cd05a9ed tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:29.507607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-06e6a863-16f0-422e-895d-29d6cd05a9ed tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1088 microversion: 2.1 time: 0.083874 Aug 12 12:24:29.508923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 424/863] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:29 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:29.552493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:29.560980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2492f37a-3b6b-4b1e-a4b2-789b790e7d10 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.473675 Aug 12 12:24:29.561737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 440/864] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:29 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:29.921925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:29.923196 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:29.930220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:29.930703 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:29.931136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:29.931828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:29.932279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:29.932737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:30.073054 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:30.082675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:30.084332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:30.085545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b63aae8d-8cc3-42ff-b6c6-9443e1fb0545 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.167632 Aug 12 12:24:30.086112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 425/865] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:29 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:30.529129 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:30.529817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:30.536909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:30.537401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:30.537929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:30.538659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:30.539172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:30.539672 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:30.544028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:30.584141 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:30.584775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:30.591504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:30.592611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:30.593906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:30.594616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:30.595070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:30.595574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:30.616865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:30.625683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9d354b33-f9fd-4af6-a8c0-1d3978ba1a92 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.100337 Aug 12 12:24:30.639500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 441/866] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:30 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:30.758945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:30.767180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b7318389-c732-4168-859e-7d33e1eaed36 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.188228 Aug 12 12:24:30.767802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 426/867] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:30 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:31.109042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:31.109654 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:31.116916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:31.117403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:31.117835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:31.118526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:31.118975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:31.119397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:31.261410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:31.270839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:31.272363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:31.273609 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5c909dbf-7d0e-4ebf-bd9f-17435ac576ac tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.169272 Aug 12 12:24:31.274173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 442/868] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:31 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:31.646975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:31.647619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:31.654643 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:31.655239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:31.655670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:31.656577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:31.657057 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:31.657477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:31.720008 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:31.727951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-913b86e1-65ed-4254-9b93-babd9bc22b5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.084880 Aug 12 12:24:31.728684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 427/869] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:31 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:31.789250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:31.789983 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:31.805311 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:31.805814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:31.806252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:31.806960 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:31.807417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:31.807986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:31.950965 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:31.959101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9bdddff5-dc18-4e2d-aef9-b9f6441073f9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.175166 Aug 12 12:24:31.959663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 443/870] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:31 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:32.296762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:32.297284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:32.304205 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:32.304684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:32.305109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:32.305792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:32.306236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:32.306664 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:32.447056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:32.455760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:32.458399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:32.459564 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fd3dd9af-ffae-4810-b098-0fe2a6c60d54 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.166767 Aug 12 12:24:32.460454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 428/871] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:32 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:32.749247 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:32.754304 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:32.755893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:32.756378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:32.756852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:32.757544 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:32.757998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:32.758425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:32.821582 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:32.829713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-76747b44-29eb-45b9-b70c-c78c9ddf0f62 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.084202 Aug 12 12:24:32.832410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 444/872] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:32 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:32.979365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:32.980061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:32.986602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:32.987156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:32.987678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:32.988719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:32.989233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:32.989719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:33.008271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:33.137572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:33.145435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a82bb3e7-17eb-4b5c-8caf-da45cc4760c7 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.169826 Aug 12 12:24:33.146006 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 429/873] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:32 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:33.482337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:33.482940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:33.489334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:33.489818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:33.490254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:33.490978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:33.491425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:33.491851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:33.636585 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:33.646394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:33.647901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:33.649104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d20ca6e0-18b1-4a79-bdd4-5a3393a6243d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.170717 Aug 12 12:24:33.649861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 445/874] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:33 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:33.852172 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:33.852715 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:33.858627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:33.859101 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:33.859529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:33.860200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:33.860660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:33.861080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:33.920506 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:33.928388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-39e52f50-71f6-4333-a77d-40453ced5073 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.080180 Aug 12 12:24:33.929376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 430/875] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:33 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:34.166008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:34.166611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:34.173446 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:34.173925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:34.174369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:34.175067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:34.175496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:34.175917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:34.309994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:34.318972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-17abe7ec-b7d6-47bf-987e-8ffbaac2edf1 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.156730 Aug 12 12:24:34.319560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 446/876] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:34 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:34.671373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:34.671971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:34.679474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:34.679951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:34.680385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:34.681140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:34.681536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:34.681952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:34.818347 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:34.839138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:34.840668 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:34.841887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a26ea34f-7b57-4153-9e76-d053e3819097 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.174410 Aug 12 12:24:34.842640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 431/877] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:34 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:34.949879 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:34.950673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:34.956963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:34.957480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:34.958015 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:34.958706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:34.959154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:34.959570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:35.021684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:35.029398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2165fa06-467f-404f-96a9-a6df69fee557 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.083380 Aug 12 12:24:35.029974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 447/878] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:34 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:35.339828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:35.340454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:35.347125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:35.347610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:35.348738 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:35.349450 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:35.349898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:35.350314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:35.494161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:35.502944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d8967ffb-2066-485a-b097-522507d36ac2 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.166810 Aug 12 12:24:35.503604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 432/879] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:35 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:35.865878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:35.866476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:35.873154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:35.873641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:35.874076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:35.874768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:35.875216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:35.875637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:36.011987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:36.021682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:36.023487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:36.024920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d4d2acf1-5e07-44bd-9fc1-8e6096619781 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.162865 Aug 12 12:24:36.025482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 448/880] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:35 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:36.051237 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:36.051827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:36.058461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:36.058930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:36.059355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:36.060023 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:36.060467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:36.060909 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:36.166689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:36.166689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-495c1a71-3485-4540-844a-4f8f363d4b69 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.086157 Aug 12 12:24:36.166689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 433/881] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:36 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:36.524862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:36.525501 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:36.532854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:36.533123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:36.533680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:36.534449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:36.534971 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:36.535484 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:36.686675 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:36.696683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4d58b3c5-4419-4a57-80f3-3f6c42c962cf tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.175531 Aug 12 12:24:36.697648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 449/882] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:36 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:37.048851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:37.049412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:37.056767 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:37.057405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:37.057765 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:37.058520 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:37.059656 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:37.059656 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:37.187049 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:37.187877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:37.195771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:37.196260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:37.196407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:37.196723 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:37.197427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:37.197918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:37.198350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:37.205922 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:37.207604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:37.209690 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a88457f6-9be8-4c42-90d2-1409097dff9d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.165265 Aug 12 12:24:37.210565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 434/883] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:37 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:37.268476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:37.276502 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-65ae4187-e1a6-40e1-981a-4bb5ea8837a4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.094074 Aug 12 12:24:37.277097 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 450/884] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:37 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:37.718791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:37.719610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:37.728396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:37.729080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:37.729579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:37.730353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:37.730860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:37.731361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:37.879897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:37.887171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0edaf330-8770-485b-9da1-f13ee492bca9 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.172705 Aug 12 12:24:37.887730 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 435/885] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:37 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:38.233942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:38.234568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:38.241033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:38.241517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:38.241949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:38.242649 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:38.243096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:38.243522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:38.297729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:38.298409 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:38.305987 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:38.306467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:38.306954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:38.307600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:38.308047 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:38.308556 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:38.391534 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:38.403805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ddf66a77-0fda-404f-ae25-60de4815b86f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.108822 Aug 12 12:24:38.416120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 436/886] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:38 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:38.429104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:38.438041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:38.439597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:38.440830 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-eb46ef56-8469-4f31-a672-85423822dfa3 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.210798 Aug 12 12:24:38.441608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 451/887] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:38 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:38.909446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:38.910235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:38.916693 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:38.917185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:38.917619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:38.918311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:38.918757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:38.919184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:38.940722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:39.054496 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:39.064072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6e55b1ec-35fd-44da-8981-a84e67b07967 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.159285 Aug 12 12:24:39.064564 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 437/888] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:38 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:39.423382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:39.423969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:39.431515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:39.431990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:39.432421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:39.433161 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:39.433612 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:39.434063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:39.464446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:39.465108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:39.472388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:39.472913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:39.473353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:39.474552 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:39.475189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:39.475619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:39.494713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:39.502211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-27222980-ed40-40e6-aec7-f1559d5fbd3b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.082658 Aug 12 12:24:39.502776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 452/889] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:39 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:39.507249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=8 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:39.608664 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:39.617221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:39.618738 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:39.619956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c521a79d-7fc6-44df-bd1c-bd6fe91d10d5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.160568 Aug 12 12:24:39.620514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 438/890] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:39 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:40.087728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:40.088364 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:40.094281 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:40.094757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:40.095184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:40.095856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:40.096300 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:40.096752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:40.225880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:40.233541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bc36c4fb-22f9-4137-906c-005b40b2af7b tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.150569 Aug 12 12:24:40.234107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 453/891] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:40 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:40.522941 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:40.523550 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:40.530037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:40.530515 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:40.530947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:40.531630 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:40.532072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:40.532500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:40.591673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:40.599450 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cfe3ea90-87f4-4983-beec-a2208764a3d8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.080005 Aug 12 12:24:40.600016 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 439/892] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:40 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:40.643081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:40.643707 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:40.650017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:40.650490 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:40.650916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:40.651590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:40.652063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:40.652480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:40.781148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:40.789852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:40.791342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:40.792476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c2ed8dd9-5eb4-471c-ba47-f53c734f8102 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.153283 Aug 12 12:24:40.793067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 454/893] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:40 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:41.253775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:41.254387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:41.261079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:41.261560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:41.261995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:41.262673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:41.263124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:41.263546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:41.391893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:41.399237 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ddd19525-6516-4331-97de-c3deaf386f27 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.149351 Aug 12 12:24:41.399793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 440/894] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:41 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:41.620481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:41.621028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:41.622920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=68 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:41.627548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:41.628018 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:41.628445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:41.629148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:41.629591 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:41.630044 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:41.689949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:41.697183 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-868fc76e-e58f-4f69-8f58-95a1934c3517 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.080605 Aug 12 12:24:41.697744 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 455/895] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:41 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:41.815877 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:41.816533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:41.823289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:41.823762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:41.824190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:41.824885 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:41.825330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:41.825745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:41.955674 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:41.964536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:41.966050 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:41.967187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c105cdce-1b8e-469d-9080-7220c5b3ba8f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.155319 Aug 12 12:24:41.967738 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 441/896] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:41 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:42.419745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:42.420351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:42.426342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:42.426821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:42.427871 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:42.428553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:42.429036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:42.429459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:42.558207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:42.565661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e63d4f14-9d20-45ca-9eb1-6a83c5334a69 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.149875 Aug 12 12:24:42.566297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 456/897] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:42 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:42.717597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:42.718131 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:42.724835 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:42.725533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:42.725979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:42.726665 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:42.727126 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:42.727554 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:42.790655 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:42.798186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4e41b43b-a039-4f6b-9c7b-3f111831bc3d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.084520 Aug 12 12:24:42.798753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 442/898] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:42 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:42.990782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:42.991304 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:42.997728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:42.998207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:42.998639 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:42.999318 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:42.999768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:43.000188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:43.127674 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:43.131561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:43.136928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:43.138432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:43.139635 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-adc6a620-c281-4446-b295-4e593575e047 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.152786 Aug 12 12:24:43.140192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 457/899] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:42 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:43.587152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:43.587693 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:43.594124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:43.594603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:43.595378 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:43.595875 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:43.596318 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:43.596759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:43.726895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:43.734712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cbf74b5c-c198-4046-a255-7c3c577ea987 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1319 microversion: 2.1 time: 0.151645 Aug 12 12:24:43.735475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 443/900] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:43 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:43.821647 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:43.822298 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:43.828862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:43.832829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:43.832829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:43.832829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:43.832829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:43.833218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:43.891386 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:43.899686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ab47840e-50b2-483d-9a2e-ba9eb099b305 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1138 microversion: 2.1 time: 0.083000 Aug 12 12:24:43.900262 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 458/901] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:43 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:44.169326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:44.170710 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:44.177131 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:44.178180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:44.178618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:44.180009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:44.180505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:44.181639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:44.378892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:44.378892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:44.380048 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:44.381385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-570ad7a5-1c01-45b2-b93e-1da1a8f25b4a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.220568 Aug 12 12:24:44.381967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 444/902] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:44 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:44.772255 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:44.773097 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:44.780269 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:44.780795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:44.781241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:44.781937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:44.782391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:44.782816 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:44.920847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:44.921448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:44.928265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:44.928777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:44.929204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:44.929887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:44.930241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:44.930370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:44.930989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:44.941771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-60cab236-99a9-404a-b173-df7927a29e7d tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1507 microversion: 2.1 time: 0.174180 Aug 12 12:24:44.942354 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 459/903] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:44 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:44.962348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba3ca02b-302d-4de5-809a-dcca91dde1ae", "device": "/dev/sdb"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:44.967820 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:44.973932 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:44.975060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:44.975509 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:44.976211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:44.976696 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:44.977118 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:44.999006 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:45.006831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f5a13cdc-8694-4321-8bfe-784365a21c1a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1130 microversion: 2.1 time: 0.089797 Aug 12 12:24:45.007573 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 445/904] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:44 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1130 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:45.403234 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:45.403839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:45.409775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:45.410251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:45.410682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:45.411356 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:45.411836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:45.412260 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:45.416191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:45.545154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:45.554020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:45.555518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:45.556963 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f890fb5f-aff9-4129-8596-98c4baf6aab1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.157557 Aug 12 12:24:45.557516 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 446/905] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:45 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:24:46.031837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:46.032472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:46.038992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:46.039468 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:46.039901 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:46.040587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:46.041067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:46.041492 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:46.103112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:46.110396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ed2ab696-dbdc-450c-9b4f-64925ee9e091 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1130 microversion: 2.1 time: 0.082420 Aug 12 12:24:46.110956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 447/906] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:46 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1130 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:24:46.580192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:46.580972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:46.587499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:46.588009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:46.588469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:46.589183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:46.589639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:46.590065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:46.723975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:46.732579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:46.734124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:46.736107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-297c8866-5a7e-4689-84d5-0e23a09ad1fd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.159055 Aug 12 12:24:46.736107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 448/907] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:46 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:46.762712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9d9fc6fc-9749-4405-8d01-e8571d644217 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "POST /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.804480 Aug 12 12:24:46.763966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 460/908] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:24:44 2022] POST /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f/os-volume_attachments => generated 194 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:24:47.132731 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:47.133366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:47.141116 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:47.141605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:47.142043 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:47.142745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:47.143239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:47.143660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:47.216113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:47.223682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ea59037f-06be-41b4-9714-d22e178e6513 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1194 microversion: 2.1 time: 0.096076 Aug 12 12:24:47.224251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 449/909] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:47 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:47.758274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:47.758860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:47.765010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:47.765639 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:47.765916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:47.766607 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:47.767055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:47.767474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:47.979988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:47.988477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:47.989998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:47.991316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fc3d0f43-70c7-42aa-b77b-27d7da35000c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.237962 Aug 12 12:24:47.991878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 461/910] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:47 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:48.245273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:48.249567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:48.249567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:24:48.253426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:48.253920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:48.254362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:48.255062 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:48.255536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:48.256717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:48.459045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:48.467286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3552ab17-319f-48df-ab30-656530ffa4d6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1271 microversion: 2.1 time: 0.225831 Aug 12 12:24:48.467909 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 450/911] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:48 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:49.014110 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:49.014710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:49.021128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:49.021684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:49.022216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:49.022885 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:49.023350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:49.023748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:49.105985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-30b32fe7-7342-48d6-a129-60f34edca85d req-ff982cab-1135-4ba6-8234-fb11beb11647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5591717-7940-402d-a1b0-737ee67b0743", "tag": "8730add4-d37a-43c9-83e1-97a8314f1259"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:24:49.115960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-30b32fe7-7342-48d6-a129-60f34edca85d req-ff982cab-1135-4ba6-8234-fb11beb11647 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:49.116451 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-30b32fe7-7342-48d6-a129-60f34edca85d req-ff982cab-1135-4ba6-8234-fb11beb11647 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:49.116904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-30b32fe7-7342-48d6-a129-60f34edca85d req-ff982cab-1135-4ba6-8234-fb11beb11647 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:49.127662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-30b32fe7-7342-48d6-a129-60f34edca85d req-ff982cab-1135-4ba6-8234-fb11beb11647 service nova] Creating event network-changed:8730add4-d37a-43c9-83e1-97a8314f1259 for instance c5591717-7940-402d-a1b0-737ee67b0743 on hv-cinder-79797 Aug 12 12:24:49.132829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-30b32fe7-7342-48d6-a129-60f34edca85d req-ff982cab-1135-4ba6-8234-fb11beb11647 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091529 Aug 12 12:24:49.136785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 451/912] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:24:49.187290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:49.196377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:49.197928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:49.199081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-74513a32-7fd0-4087-93b5-eea20f92e630 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.188870 Aug 12 12:24:49.199638 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 462/913] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:49 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:49.493828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:49.494524 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:49.500758 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:49.501235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:49.501665 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:49.502343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:49.502787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:49.503205 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:49.654162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:49.661487 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9099d7fb-f07c-4b7c-8f87-d11c7f7b4ef4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1271 microversion: 2.1 time: 0.172779 Aug 12 12:24:49.662048 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 452/914] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:49 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:50.221750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:50.222387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:50.229162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:50.229646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:50.230080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:50.230769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:50.231218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:50.231640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:50.446854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:50.455314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:50.456897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:50.458052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-91ddfcdf-cdea-4834-9793-31b57741b505 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.240208 Aug 12 12:24:50.458629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 463/915] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:50 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:50.683346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:50.683962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:50.690390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:50.690865 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:50.691298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:50.692170 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:50.692626 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:50.693065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:50.824426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:50.831773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-43d828d6-130d-4024-bd93-9931422fc0f4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1271 microversion: 2.1 time: 0.153180 Aug 12 12:24:50.832333 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 453/916] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:50 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:51.481608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:51.490416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:51.490416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:51.490416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:51.490416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:51.490794 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:51.491062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:51.492122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:51.625505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:51.633857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:51.635351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:51.636481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f43376d4-6312-49ce-b83e-4a09c19c8704 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.158880 Aug 12 12:24:51.637056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 464/917] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:51 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:51.853514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:51.854111 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:51.860441 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:51.860950 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:51.861380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:51.862053 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:51.862500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:51.862915 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:51.991224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:51.999086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5ffe6da9-d28a-4c14-9f72-70c955bf5f32 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1271 microversion: 2.1 time: 0.150029 Aug 12 12:24:52.000191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 454/918] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:51 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:52.659455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:52.660042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:52.666927 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:52.667408 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:52.667843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:52.668524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:52.669004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:52.669428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:52.798459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:52.807850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:52.811759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:52.811759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e6b265d6-0cc0-41a1-b17b-3f399e7bf5d4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.155121 Aug 12 12:24:52.811759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 465/919] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:52 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:53.019685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:53.020220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:53.026674 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:53.027156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:53.027593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:53.028304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:53.028783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:53.029205 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:53.309893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:53.317160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1dea3610-2e95-45c4-886c-0a59156b0886 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1271 microversion: 2.1 time: 0.301447 Aug 12 12:24:53.317711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 455/920] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:53 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:53.834280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:53.834881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:53.841646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:53.842118 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:53.842546 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:53.843220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:53.843659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:53.844074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:53.974318 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:53.983529 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:53.985140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:53.986280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-832081c8-e152-4117-81d5-5cad6b7ee55c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.155905 Aug 12 12:24:53.986850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 466/921] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:53 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:54.337773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:54.338370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:54.344820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:54.345297 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:54.345726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:54.346396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:54.346842 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:54.347266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:54.484587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:54.492401 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-888d2d2a-db0c-477e-8e52-2d50bab81b07 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1271 microversion: 2.1 time: 0.158928 Aug 12 12:24:54.493262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 456/922] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:54 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:55.010224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:55.010860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:55.017345 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:55.017846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:55.018267 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:55.019095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:55.019531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:55.019961 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:55.152451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:55.160948 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:55.162548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:55.163693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8ea996f1-0387-4e6b-aaa0-be1ab4c73b53 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.158139 Aug 12 12:24:55.164248 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 467/923] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:55 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:55.513715 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:55.514357 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:55.520831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:55.521315 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:55.521753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:55.522441 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:55.522893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:55.523311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:55.655601 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:55.663029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1458e731-1475-49df-a805-d53814b8d7d5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1271 microversion: 2.1 time: 0.153173 Aug 12 12:24:55.663588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 457/924] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:55 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:56.186865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:56.187612 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:56.194275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:56.194763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:56.195423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:56.196053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:56.197179 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:56.197607 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:56.328191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:56.336723 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:56.339038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:56.340200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ac1a6396-2879-46ec-903c-cb40c04cbe75 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.157540 Aug 12 12:24:56.340798 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 468/925] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:56 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:56.685242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:56.685785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:56.692512 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:56.693125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:56.693567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:56.694258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:56.694711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:56.698978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:56.842622 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:56.846769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4e39021c-dcd7-44d8-b44c-8abfc69c1e18 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1271 microversion: 2.1 time: 0.166204 Aug 12 12:24:56.847572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 458/926] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:56 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:57.363224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:57.363868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:57.370894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:57.371376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:57.371816 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:57.372510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:57.373002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:57.378815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:57.507552 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:57.516900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:57.518444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:57.519615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-dd75d631-a0ee-4be6-88af-158ecc041c4d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.160482 Aug 12 12:24:57.520172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 469/927] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:57 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:57.867499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:57.868109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:57.875299 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:57.875784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:57.876220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:57.876928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:57.877378 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:57.877799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:58.005835 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:58.013719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d0b28108-8bfc-40a1-b01f-4b9f0305018a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.150050 Aug 12 12:24:58.014269 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 459/928] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:57 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:58.543835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:58.544473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:58.551069 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:58.551610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:58.552042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:58.552761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:58.553204 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:58.553855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:58.687558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:58.696025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:58.698260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:58.699422 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-62557040-eeca-4b10-9690-06bef16f2b50 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.160140 Aug 12 12:24:58.699989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 470/929] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:58 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:24:59.033898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:59.034509 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:59.040944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:59.041443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:59.041883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:59.042603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:59.043019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:59.043450 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:59.172434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:59.179814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2a82c264-1bc1-4e5c-9f41-f64e5b225634 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.149781 Aug 12 12:24:59.180380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 460/930] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:24:59 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:24:59.722354 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:24:59.722957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:24:59.730076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:59.730550 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:59.730977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:59.731648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:24:59.732090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:24:59.732503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:24:59.859259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:59.867863 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:59.870010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:24:59.871164 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-03ff0c65-8427-41d4-9657-51c2861d28ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.152745 Aug 12 12:24:59.871937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 471/931] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:24:59 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:00.201844 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:00.202532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:00.208988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:00.209461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:00.209894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:00.210568 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:00.211014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:00.211433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:00.344250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:00.351570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7ae31c40-ab32-4f69-8cdd-75e41c515cde tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.153587 Aug 12 12:25:00.352133 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 461/932] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:00 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:00.893468 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:00.894072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:00.901188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:00.901663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:00.902091 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:00.902792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:00.903220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:00.903634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:01.030025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:01.038271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:01.039769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:01.041772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-200551b8-d2d3-4413-9f2c-7558ba15d792 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.152158 Aug 12 12:25:01.042331 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 472/933] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:00 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:01.371382 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:01.371984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:01.378338 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:01.378814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:01.379244 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:01.379970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:01.380418 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:01.380873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:01.512085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:01.519443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fe02ced3-f611-41c6-a378-75eb61a3879a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.152068 Aug 12 12:25:01.520002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 462/934] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:01 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:02.064597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:02.065184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:02.071685 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:02.072195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:02.072658 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:02.073341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:02.073794 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:02.074222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:02.078258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:02.203404 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:02.211605 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:02.213185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:02.214324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-af44d51d-039a-4cb8-9664-861faa9a58da tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.153673 Aug 12 12:25:02.214896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 473/935] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:02 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:02.541262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:02.541867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:02.548250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:02.548783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:02.549218 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:02.549903 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:02.550352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:02.550770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:02.568390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:02.681488 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:02.689257 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d6ab6861-6d01-463b-adbf-19f124f6fb22 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.152479 Aug 12 12:25:02.689820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 463/936] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:02 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:03.237631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:03.238225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:03.245557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:03.247558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:03.247558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:03.247558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:03.247840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:03.248058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:03.375665 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:03.384001 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:03.386245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:03.387392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c6cc103f-89f8-4a70-8920-c150d490c99a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.153618 Aug 12 12:25:03.387945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 474/937] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:03 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:03.709861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:03.710470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:03.716895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:03.717379 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:03.717814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:03.718499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:03.718951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:03.719377 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:03.852325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:03.860989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1b9575e7-ab23-4740-babe-f4a2c14bebe7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.154862 Aug 12 12:25:03.861571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 464/938] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:03 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:04.030820 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-e12671c1-c7a1-41ec-ba16-6f2f0679c313 req-9628b148-973a-44a3-9adb-82d69560d627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e50626-b455-4357-8ab1-4ed9dea35297", "name": "network-vif-plugged", "status": "completed", "tag": "ea96cc24-3c69-42d6-a3cc-6f2a132e8057"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:25:04.041540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-e12671c1-c7a1-41ec-ba16-6f2f0679c313 req-9628b148-973a-44a3-9adb-82d69560d627 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:04.042123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-e12671c1-c7a1-41ec-ba16-6f2f0679c313 req-9628b148-973a-44a3-9adb-82d69560d627 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:04.042730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-e12671c1-c7a1-41ec-ba16-6f2f0679c313 req-9628b148-973a-44a3-9adb-82d69560d627 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:04.058178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-e12671c1-c7a1-41ec-ba16-6f2f0679c313 req-9628b148-973a-44a3-9adb-82d69560d627 service nova] Creating event network-vif-plugged:ea96cc24-3c69-42d6-a3cc-6f2a132e8057 for instance 87e50626-b455-4357-8ab1-4ed9dea35297 on hv-cinder-79797 Aug 12 12:25:04.061715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-e12671c1-c7a1-41ec-ba16-6f2f0679c313 req-9628b148-973a-44a3-9adb-82d69560d627 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090552 Aug 12 12:25:04.062480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 475/939] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:25:04.409533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:04.410243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:04.416283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:04.416802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:04.417272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:04.417948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:04.418398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:04.418831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:04.552257 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:04.560997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:04.565018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:04.565018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0115d527-d1f3-4d41-aefc-5b5d52d3853a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.158253 Aug 12 12:25:04.565018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 465/940] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:04 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:04.882802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:04.883397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:04.890413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:04.890889 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:04.891320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:04.892000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:04.892445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:04.892900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:05.026979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:05.034403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-36a0870a-2850-4b36-a2db-1c93a00b4f73 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.156332 Aug 12 12:25:05.034969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 476/941] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:04 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:05.586742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:05.587347 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:05.594233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:05.594712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:05.595143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:05.595824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:05.596325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:05.596727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:05.722677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:05.731740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:05.733269 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:05.734414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ba3bbde3-2a9b-4326-a001-b70e434493cd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.151565 Aug 12 12:25:05.734978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 466/942] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:05 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:06.054645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:06.055250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:06.062002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:06.062481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:06.062915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:06.063597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:06.064047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:06.064470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:06.193108 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:06.201468 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4e0af01a-16b4-4c66-83b5-7de11ccfe5b7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.150614 Aug 12 12:25:06.202110 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 477/943] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:06 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:06.756298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:06.756922 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:06.763810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:06.764281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:06.764735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:06.765436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:06.765884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:06.766298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:06.899374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:06.907835 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:06.909385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:06.910534 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b79f28d4-5665-4439-b665-d192196992ba tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.158148 Aug 12 12:25:06.911088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 467/944] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:06 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:07.222423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:07.223048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:07.229963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:07.230437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:07.230866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:07.231540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:07.231986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:07.232401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:07.360878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:07.368496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-24b06165-6b4f-4c49-95e9-9ca55a5f587c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.149911 Aug 12 12:25:07.369187 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 478/945] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:07 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:07.932796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:07.933399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:07.939957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:07.940435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:07.940899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:07.941577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:07.942042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:07.942462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:08.070830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:08.079808 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:08.081461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:08.082614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-22f41a8d-a84a-4fa9-9477-270917f08b04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.153837 Aug 12 12:25:08.083167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 468/946] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:07 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:08.390651 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:08.391166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:08.397509 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:08.397989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:08.398420 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:08.399103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:08.399551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:08.399974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:08.536074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:08.543755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-64f208aa-d845-406f-9e11-fd8e224b10ca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.157076 Aug 12 12:25:08.544326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 479/947] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:08 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:09.107024 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:09.107572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:09.113959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:09.114433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:09.114860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:09.115531 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:09.115980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:09.116398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:09.245526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:09.254353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:09.255873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:09.257065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7c23879b-e164-4d38-8ae2-88c72b51867e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.154594 Aug 12 12:25:09.257629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 469/948] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:09 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:25:09.563606 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:09.564210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:09.570634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:09.574391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:09.574391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:09.574391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:09.574391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:09.574736 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:09.702702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:09.709978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7f0b3736-42a5-447f-9a4d-8590a4b7f1ec tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.150455 Aug 12 12:25:09.710545 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 480/949] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:09 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:10.279878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:10.280506 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:10.287070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:10.287545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:10.287977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:10.288664 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:10.289111 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:10.289530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:10.425410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:10.435108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:10.436694 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:10.438015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-92f27980-9bce-4781-bfce-665690257fad tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.162111 Aug 12 12:25:10.438561 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 470/950] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:10 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:10.730223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:10.731571 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:10.738024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:10.738497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:10.738926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:10.739593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:10.740039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:10.740451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:10.873087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:10.880712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d8d1b5fd-c009-41e7-8b57-c878e92c2fe8 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.154310 Aug 12 12:25:10.881280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 481/951] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:10 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:11.463717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:11.464315 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:11.470750 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:11.471228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:11.471659 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:11.472345 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:11.472815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:11.473233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:11.601993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:11.609978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:11.611463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:11.612603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4fd6e801-8416-4645-9c44-06ba4bcc14e0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.152863 Aug 12 12:25:11.613178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 471/952] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:11 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:11.902528 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:11.903433 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:11.906469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=54 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:11.911834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:11.912307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:11.912760 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:11.913443 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:11.913889 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:11.914306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:12.045227 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:12.052482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-65f651da-b884-4543-9ae6-70ab07ce8b56 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.154024 Aug 12 12:25:12.053071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 482/953] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:11 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:12.635412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:12.636048 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:12.642461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:12.642932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:12.643361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:12.644045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:12.644477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:12.644931 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:12.773122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:12.782343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:12.783830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:12.785013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-59541de2-9359-46ab-912e-25fdb6cee93f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.153666 Aug 12 12:25:12.785571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 472/954] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:12 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:13.073396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:13.074020 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:13.080374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:13.080891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:13.081343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:13.082018 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:13.082463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:13.082880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:13.209783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:13.217827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-33ea8c47-684b-4379-9892-a9d69e43122d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.148231 Aug 12 12:25:13.218395 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 483/955] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:13 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:13.808816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:13.809456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:13.817069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:13.821184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:13.821184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:13.821184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:13.821184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:13.821636 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:13.961837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:13.971001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:13.972546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:13.973762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-542a5936-7dfe-4921-8c0f-8d57d9d5f201 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1810 microversion: 2.20 time: 0.169121 Aug 12 12:25:13.974329 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 473/956] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:13 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:25:14.046117 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:14.046610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:14.053152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:14.053663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:14.054191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:14.054756 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:14.055207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:14.055726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:14.140612 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lazy-loading 'services' on Instance uuid 91e74f6c-69a9-41ae-a546-7c2ae724731f {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:25:14.238372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:14.238968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:14.244895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:14.245371 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:14.245801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:14.246484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:14.246951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:14.247370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:14.378627 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5d4a685e-2e05-4825-9ba9-5a2fb9301901 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "DELETE /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f/os-volume_attachments/ba3ca02b-302d-4de5-809a-dcca91dde1ae" status: 202 len: 0 microversion: 2.1 time: 0.336613 Aug 12 12:25:14.379943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 484/957] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:25:14 2022] DELETE /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f/os-volume_attachments/ba3ca02b-302d-4de5-809a-dcca91dde1ae => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:25:14.387580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:14.396691 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e4898aff-9eca-4653-afa0-86d01dc7cd5f tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.162063 Aug 12 12:25:14.397294 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 474/958] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:14 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:14.999082 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:14.999774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:15.006032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:15.006512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:15.006942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:15.007687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:15.008137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:15.008559 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:15.142447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:15.150944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:15.152462 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:15.153698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0c5bb8cc-6da0-41a3-a761-9b0a5167182c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1797 microversion: 2.20 time: 0.159629 Aug 12 12:25:15.158874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 485/959] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:25:14 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1797 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:25:15.417791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:15.418429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:15.425116 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:15.425634 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:15.426075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:15.426768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:15.427226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:15.427653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:15.560925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:15.568406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-472bd211-d3d6-41c9-8fc9-108525de0b5a tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.154463 Aug 12 12:25:15.569148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 475/960] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:15 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:16.589950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:16.590562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:16.597611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:16.598091 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:16.598521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:16.599210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:16.599659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:16.600077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:16.679707 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-e4de6659-59e9-4e46-a2de-2a206be3896b req-03163fac-bd5f-4ab0-acac-589988135a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5591717-7940-402d-a1b0-737ee67b0743", "name": "network-vif-plugged", "status": "completed", "tag": "8730add4-d37a-43c9-83e1-97a8314f1259"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:25:16.693197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-e4de6659-59e9-4e46-a2de-2a206be3896b req-03163fac-bd5f-4ab0-acac-589988135a88 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:16.693672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-e4de6659-59e9-4e46-a2de-2a206be3896b req-03163fac-bd5f-4ab0-acac-589988135a88 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:16.694097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-e4de6659-59e9-4e46-a2de-2a206be3896b req-03163fac-bd5f-4ab0-acac-589988135a88 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:16.705655 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-e4de6659-59e9-4e46-a2de-2a206be3896b req-03163fac-bd5f-4ab0-acac-589988135a88 service nova] Creating event network-vif-plugged:8730add4-d37a-43c9-83e1-97a8314f1259 for instance c5591717-7940-402d-a1b0-737ee67b0743 on hv-cinder-79797 Aug 12 12:25:16.710714 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-e4de6659-59e9-4e46-a2de-2a206be3896b req-03163fac-bd5f-4ab0-acac-589988135a88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035387 Aug 12 12:25:16.711247 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 476/961] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:25:16.755484 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:16.763514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2d99f723-88d3-4f56-a766-dfce64e17063 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.177376 Aug 12 12:25:16.766466 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 486/962] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:16 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:17.614213 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:17.614789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:17.620907 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:17.621399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:17.621828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:17.622500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:17.622966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:17.623384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:17.647576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:25:17.784426 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:17.785052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:17.791482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:17.791992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:17.792419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:17.793121 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:17.793625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:17.794046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:17.928237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:17.936287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dd77d45a-1790-4692-8b2f-778b6c40d103 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "DELETE /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 204 len: 0 microversion: 2.1 time: 0.322832 Aug 12 12:25:17.936806 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f7dc4c31-38e6-4e6c-9e89-f69dc4d06ad4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.155591 Aug 12 12:25:17.938030 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 477/963] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:25:17 2022] DELETE /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:25:17.938173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 487/964] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:17 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:17.945664 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:17.949619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:17.952912 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:17.953395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:17.953826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:17.954504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:17.954951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:17.955363 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:18.093005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:18.100658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7f367bfc-1a40-4bfc-9452-e818ba3ea292 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1513 microversion: 2.1 time: 0.159044 Aug 12 12:25:18.101243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 478/965] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:17 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:18.957849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:18.958456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:18.964863 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:18.965343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:18.965776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:18.966456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:18.967435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:18.967857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:19.094971 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:19.102251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-16c1e991-e741-412e-9d5a-3f837708a941 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.148252 Aug 12 12:25:19.102810 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 488/966] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:18 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:19.121541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:19.122153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:19.124731 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:19.129372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:19.129853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:19.130283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:19.130961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:19.131405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:19.131826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:19.135756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:19.261944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:19.269781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fcec9b51-47b5-4536-8260-250995c7d367 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1513 microversion: 2.1 time: 0.152016 Aug 12 12:25:19.270344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 479/967] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:19 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:20.123454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:20.124749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:20.131085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:20.131561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:20.131987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:20.132686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:20.133137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:20.133553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:20.262168 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:20.266019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:20.270297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-05925fdc-a983-4213-bb2b-9125f921e4c3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.150785 Aug 12 12:25:20.270867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 489/968] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:20 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:20.291304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:20.291940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:20.299904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:20.300385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:20.300859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:20.301551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:20.302007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:20.302432 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:20.432124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:20.439855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-75468281-e4d3-4702-90b4-43a6ef053a2f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1513 microversion: 2.1 time: 0.152431 Aug 12 12:25:20.440416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 480/969] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:20 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:21.291815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:21.292423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:21.300140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:21.300617 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:21.301071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:21.301784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:21.302233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:21.302657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:21.434472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:21.442266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0ca5063d-aff5-4a21-8f69-8ef7e82c9d72 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1259 microversion: 2.1 time: 0.154302 Aug 12 12:25:21.442838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 490/970] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:21 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:21.460760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:21.461367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:21.469042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:21.469522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:21.469953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:21.470641 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:21.471110 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:21.471529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:21.598709 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:21.606088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7f82b13e-a614-4693-914b-9ab0eadeaec4 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1513 microversion: 2.1 time: 0.149211 Aug 12 12:25:21.606654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 481/971] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:21 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:22.463348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:22.463944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:22.470778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:22.471251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:22.471679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:22.472387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:22.472879 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:22.473295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:22.627670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:22.628252 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:22.634586 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:22.635064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:22.635498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:22.636178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:22.636632 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:22.637073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:22.639424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:22.648572 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-76387faa-87e3-465b-aa97-48af099c2a17 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1443 microversion: 2.1 time: 0.189059 Aug 12 12:25:22.649188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 491/972] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:22 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1443 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:22.669471 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:22.672722 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:22.676478 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:22.677094 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:22.677530 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:22.678221 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:22.678678 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:22.679101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:22.928397 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:22.936074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3d57a205-214f-4541-bad6-da19479f508f tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1513 microversion: 2.1 time: 0.312891 Aug 12 12:25:22.937525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 482/973] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:22 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:22.968245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:22.975784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cbbb974d-4bb4-4585-b524-4d10dbe2f11e tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1443 microversion: 2.1 time: 0.310321 Aug 12 12:25:22.976440 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 492/974] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:22 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1443 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:23.292910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-da6b0a2b-28fb-492a-924d-7a79a23d0bd5 req-17661714-4099-4473-a405-0368d5f03892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e74f6c-69a9-41ae-a546-7c2ae724731f", "name": "network-vif-deleted", "tag": "b8aeabd8-d907-449f-aee7-11888e4170e4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:25:23.302940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-da6b0a2b-28fb-492a-924d-7a79a23d0bd5 req-17661714-4099-4473-a405-0368d5f03892 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:23.303421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-da6b0a2b-28fb-492a-924d-7a79a23d0bd5 req-17661714-4099-4473-a405-0368d5f03892 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:23.306615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-da6b0a2b-28fb-492a-924d-7a79a23d0bd5 req-17661714-4099-4473-a405-0368d5f03892 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:23.315171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-da6b0a2b-28fb-492a-924d-7a79a23d0bd5 req-17661714-4099-4473-a405-0368d5f03892 service nova] Creating event network-vif-deleted:b8aeabd8-d907-449f-aee7-11888e4170e4 for instance 91e74f6c-69a9-41ae-a546-7c2ae724731f on hv-cinder-79797 Aug 12 12:25:23.320337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-da6b0a2b-28fb-492a-924d-7a79a23d0bd5 req-17661714-4099-4473-a405-0368d5f03892 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031068 Aug 12 12:25:23.321005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 483/975] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:25:23.601042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:23.601562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:23.607917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:23.609220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:23.609890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:23.610631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:23.611076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:23.611491 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:23.634748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b83e15dd-8148-470e-92d8-e1040aab5b13 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/ips" status: 200 len: 144 microversion: 2.1 time: 0.037652 Aug 12 12:25:23.635324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 493/976] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:25:23 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:25:23.960487 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:23.961259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:23.967417 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:23.968549 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:23.969030 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:23.969772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:23.970220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:23.970639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:24.002978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:24.003178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:24.003613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:24.004060 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lazy-loading 'fault' on Instance uuid 91e74f6c-69a9-41ae-a546-7c2ae724731f {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:25:24.046448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07db808b777b4407ac05f3f0fa2394f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b3e4986e72478bb46a86e1e9e3355c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:24.054103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9f354f70-080c-4406-9ba3-9069ddb4eb68 tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 200 len: 1309 microversion: 2.1 time: 0.098433 Aug 12 12:25:24.055925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 484/977] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:23 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:25.036444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-81610852-304f-4b52-b6dc-613579b3c6a5 req-c59e611a-47bb-4d03-a68a-0b1ce29f96da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5591717-7940-402d-a1b0-737ee67b0743", "tag": "8730add4-d37a-43c9-83e1-97a8314f1259"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:25:25.046014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-81610852-304f-4b52-b6dc-613579b3c6a5 req-c59e611a-47bb-4d03-a68a-0b1ce29f96da service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:25.047033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-81610852-304f-4b52-b6dc-613579b3c6a5 req-c59e611a-47bb-4d03-a68a-0b1ce29f96da service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:25.047463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-81610852-304f-4b52-b6dc-613579b3c6a5 req-c59e611a-47bb-4d03-a68a-0b1ce29f96da service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:25.060341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-81610852-304f-4b52-b6dc-613579b3c6a5 req-c59e611a-47bb-4d03-a68a-0b1ce29f96da service nova] Creating event network-changed:8730add4-d37a-43c9-83e1-97a8314f1259 for instance c5591717-7940-402d-a1b0-737ee67b0743 on hv-cinder-79797 Aug 12 12:25:25.065983 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-81610852-304f-4b52-b6dc-613579b3c6a5 req-c59e611a-47bb-4d03-a68a-0b1ce29f96da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087415 Aug 12 12:25:25.066615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 494/978] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:25:25.100105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:25.100105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] [instance: 91e74f6c-69a9-41ae-a546-7c2ae724731f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:25.100105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:25.100105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:25.100869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:25.100869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:25.100869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:25.100869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] HTTP exception thrown: Instance 91e74f6c-69a9-41ae-a546-7c2ae724731f could not be found. Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Request method failure captured: Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f HTTP/1.1 Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kXA8y5oznvIFe6-kCxRIdZJ72GvfwizN0QA1PH1Lb5k1z-T_Jv7ZYZrsKcAa9B6LyzysTtCMsv55LVKTf91ePOgaP-PG0qXZF6s4saE-6TbJXLKD1SjcNud1kiAyE_cZFm1XygGvK2OGNt25pM413ig1FzFwNfECqOr0RJ4AN3z3Jo Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: f1b3e4986e72478bb46a86e1e9e3355c Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1574389223 Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:25:25.101184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b3e4986e72478bb46a86e1e9e3355c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b3e4986e72478bb46a86e1e9e3355c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b3e4986e72478bb46a86e1e9e3355c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b3e4986e72478bb46a86e1e9e3355c"}]}] Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesSnapshotTestJSON-1574389223 Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: f1b3e4986e72478bb46a86e1e9e3355c Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1574389223 Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesSnapshotTestJSON-1574389223-project Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 07db808b777b4407ac05f3f0fa2394f8 Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesSnapshotTestJSON-1574389223-project Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 91e74f6c-69a9-41ae-a546-7c2ae724731f could not be found. Aug 12 12:25:25.102910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '91e74f6c-69a9-41ae-a546-7c2ae724731f'} Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e74f6c-69a9-41ae-a546-7c2ae724731f could not be found. Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:25:25.103816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e74f6c-69a9-41ae-a546-7c2ae724731f could not be found. Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e74f6c-69a9-41ae-a546-7c2ae724731f could not be found. Aug 12 12:25:25.105790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:25:25.106989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] Returning 404 to user: Instance 91e74f6c-69a9-41ae-a546-7c2ae724731f could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:25:25.106989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-862887cc-0313-4948-8302-bbf96b77041c tempest-VolumesSnapshotTestJSON-1574389223 tempest-VolumesSnapshotTestJSON-1574389223-project] 10.222.0.27 "GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f" status: 404 len: 111 microversion: 2.1 time: 0.030632 Aug 12 12:25:25.106989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 485/979] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:25 2022] GET /compute/v2.1/servers/91e74f6c-69a9-41ae-a546-7c2ae724731f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:25:27.732175 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f467aa86-93f1-4809-942e-1bacc90038f3"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:25:27.735209 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:27.741901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:27.742403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:27.742844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:27.743668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:27.744023 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:27.744448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:28.544103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e391b6b3-1d4d-4ebd-95c8-5f27a9239a73 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816830 Aug 12 12:25:28.544658 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 495/980] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:25:27 2022] POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:25:44.564770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0b71c941-4e42-445e-92a8-f0cabaad9fb7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:25:44.567748 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=15 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:44.568399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=34 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:44.573067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b71c941-4e42-445e-92a8-f0cabaad9fb7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:44.573572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b71c941-4e42-445e-92a8-f0cabaad9fb7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:44.573997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b71c941-4e42-445e-92a8-f0cabaad9fb7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:44.638448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0b71c941-4e42-445e-92a8-f0cabaad9fb7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Going to try to stop instance {{(pid=121153) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 12:25:44.807159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0b71c941-4e42-445e-92a8-f0cabaad9fb7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/action" status: 202 len: 0 microversion: 2.1 time: 0.246262 Aug 12 12:25:44.807692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 486/981] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:25:44 2022] POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:25:44.814351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=27 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:44.815128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:25:44.819852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:44.820570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:44.826539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:44.827012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:44.827444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:44.828123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:44.828669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:44.829073 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:44.960426 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:44.968170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0b75e9b6-354e-42cc-969d-a742f0b922e2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.155845 Aug 12 12:25:44.968768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 496/982] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:44 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:45.448723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:25:45.448959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:25:45.989778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:45.991105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:45.997862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:45.998342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:45.998777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:45.999575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:46.000074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:46.000524 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:46.130638 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:46.138647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-35090fe0-6e2a-4619-bce3-01d993f2a0be tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.153982 Aug 12 12:25:46.139201 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 487/983] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:45 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:47.160353 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:47.160975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:47.167939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:47.168416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:47.168884 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:47.169568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:47.170018 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:47.170432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:47.307288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:47.315536 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-23843a8a-1cdf-485a-92ac-3be951e97052 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.159639 Aug 12 12:25:47.316237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 497/984] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:47 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:48.339082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:48.339689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:48.346165 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:48.346644 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:48.347073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:48.347751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:48.348197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:48.348614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:48.475526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:48.484432 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-467cc46f-7d85-499f-99b8-1a29085be9fe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.149965 Aug 12 12:25:48.487628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 488/985] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:48 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:49.505889 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:49.506504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:49.513272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:49.513791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:49.514252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:49.514946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:49.515402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:49.515832 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:49.645978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:49.654013 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2f13449c-7e47-4e54-97c3-7cf9af3d6cf8 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.152108 Aug 12 12:25:49.654575 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 498/986] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:49 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:50.675430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:50.676035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:50.683035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:50.683439 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:50.683874 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:50.684559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:50.685036 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:50.685462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:50.813458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:50.822442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3cfe534f-b5dd-4c2c-8835-ba3a09098edf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.150959 Aug 12 12:25:50.823001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 489/987] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:50 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:51.843293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:51.843895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:51.850233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:51.850708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:51.851138 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:51.851837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:51.852261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:51.852698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:51.980147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:51.987957 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7bc9f5b0-6d67-4406-a21f-6c3b4cf9f507 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.148529 Aug 12 12:25:51.988529 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 499/988] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:51 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:53.009630 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:53.010248 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:53.016785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:53.017273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:53.017714 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:53.018402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:53.018859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:53.019288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:53.149083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:53.157008 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-56acf0a6-6967-4367-b2a6-233cefe90c56 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.151454 Aug 12 12:25:53.157573 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 490/989] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:53 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:54.176906 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:54.177518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:54.184976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:54.185467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:54.185925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:54.186626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:54.187213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:54.187639 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:54.464802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:54.472717 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-76d8118b-5ce4-4e46-9640-106e8d3239e5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.299655 Aug 12 12:25:54.473285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 500/990] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:54 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:55.494891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:55.495499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:55.502045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:55.502531 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:55.502966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:55.503658 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:55.504110 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:55.504533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:55.871547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:55.879372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-566f71e8-35ca-4306-98b0-0177fab15cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.389585 Aug 12 12:25:55.879951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 491/991] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:55 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:25:56.899904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:56.900633 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:56.907251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:56.907725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:56.908152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:56.909822 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:56.910354 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:56.911918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:57.048238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:57.057397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2194b110-d89b-4f20-9771-21f936c723b4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.161463 Aug 12 12:25:57.057970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 501/992] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:56 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:58.079005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:58.079616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:58.086039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:58.086547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:58.086981 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:58.087660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:58.088112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:58.088535 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:58.222443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:58.230947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1de91af4-32f9-4220-a101-28a103d0e0f2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.155863 Aug 12 12:25:58.231544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 492/993] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:58 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:25:59.253431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:25:59.254478 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:25:59.261833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:59.262317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:59.262778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:59.263465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:25:59.263910 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:25:59.264328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:25:59.464285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:25:59.473587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b576b818-9c8b-4295-bc3f-eb8e35e5a890 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.224417 Aug 12 12:25:59.476669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 502/994] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:25:59 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:00.495878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:00.496728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:00.502846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:00.504896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:00.504896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:00.504896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:00.504896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:00.505401 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:00.717845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:00.740877 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d9e951c4-7fa1-4f62-844a-ca5cd1628de0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1722 microversion: 2.1 time: 0.239781 Aug 12 12:26:00.740877 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 493/995] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:00 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:01.754593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:01.755213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:01.763100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:01.763594 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:01.764036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:01.764778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:01.765233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:01.765656 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:01.931680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:01.940167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4fbb212c-96d6-4a83-aa99-5882d4150293 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1699 microversion: 2.1 time: 0.189962 Aug 12 12:26:01.941375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 503/996] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:01 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1699 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:01.962474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-db084642-cfeb-48a7-9d37-80850e1ad631 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:01.969166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db084642-cfeb-48a7-9d37-80850e1ad631 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:01.969649 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db084642-cfeb-48a7-9d37-80850e1ad631 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:01.970041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-db084642-cfeb-48a7-9d37-80850e1ad631 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:01.994580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-db084642-cfeb-48a7-9d37-80850e1ad631 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Going to try to start instance {{(pid=121153) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 12:26:02.174887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-db084642-cfeb-48a7-9d37-80850e1ad631 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/action" status: 202 len: 0 microversion: 2.1 time: 0.216754 Aug 12 12:26:02.176471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 494/997] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:26:01 2022] POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 12:26:02.186326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:02.187300 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:02.197495 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:02.198683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:02.199453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:02.200477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:02.201411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:02.201961 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:02.512831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:02.522840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-93a04254-a51e-46b0-9e95-e8a764a18caa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1708 microversion: 2.1 time: 0.340946 Aug 12 12:26:02.537673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 504/998] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:02 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1708 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:03.078959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "203ead5c-8cf3-4a72-b57d-6af7be21e7d0"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:03.081746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:03.090215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:03.091325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:03.091925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:03.092891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:03.093611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:03.094200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:03.547389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:03.548968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:03.556359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:03.559041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:03.559041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:03.559041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:03.559041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:03.559500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:03.891510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:03.902285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0bc3bcd5-8737-4c70-8755-7ccb42875abe tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1708 microversion: 2.1 time: 0.359402 Aug 12 12:26:03.906095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 505/999] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:03 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1708 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:03.999056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4454a457-3cdc-46d8-959c-83a4aff11b18 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.220615 Aug 12 12:26:03.999902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 495/1000] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:26:02 2022] POST /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments => generated 194 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:04.926518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:04.927136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:04.934924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:04.935418 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:04.935859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:04.936563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:04.937046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:04.937477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:05.085882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:05.096320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-175b60f4-7d75-485f-aa3d-687cbc71481d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1708 microversion: 2.1 time: 0.173764 Aug 12 12:26:05.096922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 506/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:04 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1708 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:06.120271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:06.121585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:06.136785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:06.137508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:06.138125 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:06.139153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:06.139764 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:06.140327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:06.317875 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:06.327867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d960ba0d-8aac-4abc-b6a7-2b6eec203ce6 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1712 microversion: 2.1 time: 0.212978 Aug 12 12:26:06.328686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 496/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:06 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1712 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:10.431926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-54c440f0-3a83-4f04-b582-b8bab7734176 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Action: 'create', calling method: .version_select at 0x7f990ee1fb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1386494864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp1Pi5ILixa7tTmoeSH85BydbK9WjH3r80444/cqf/9XZWWlj1XlwGW18mVn5J3KYmqmamQAsa2+8aAEhNhFe4MULI8xDaH7GgKxm1bB402L1p1D93O6D3U606L+MezVQ=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:10.449713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-54c440f0-3a83-4f04-b582-b8bab7734176 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Getting quotas for project 566d2428ccbe41888b9619faf5f212a2. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:26:10.453751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-54c440f0-3a83-4f04-b582-b8bab7734176 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Getting quotas for user a90e3591b4144fdfb8b5ed5391aec7c6 and project 566d2428ccbe41888b9619faf5f212a2. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:26:10.545457 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-54c440f0-3a83-4f04-b582-b8bab7734176 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.284475 Aug 12 12:26:10.546060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 507/1003] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:26:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:12.724208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:12.727366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:12.735288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:12.735946 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:12.736379 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:12.737472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:12.738292 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:12.738871 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:12.766334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lazy-loading 'flavor' on Instance uuid 836dc0f4-7d00-4730-9828-909cded7ec39 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:26:12.976781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:13.150130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0663f0e5-776b-4068-8959-c49da59da302 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/action" status: 200 len: 32 microversion: 2.1 time: 0.429436 Aug 12 12:26:13.155352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 497/1004] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:26:12 2022] POST /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/action => generated 32 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:26:13.161057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:13.161843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:13.170447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:13.171017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:13.171513 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:13.172295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:13.172837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:13.173339 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:13.366061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:13.375206 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cf969adc-c1f8-4e24-b6b5-be606510377a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.218273 Aug 12 12:26:13.376217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 508/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:13 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:14.399422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:14.401364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:14.411466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:14.411954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:14.412392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:14.413117 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:14.413579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:14.414000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:14.548932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:14.557574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-235eb373-2ff0-42ce-b13b-a7d63937c974 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.162928 Aug 12 12:26:14.558127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 498/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:14 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:15.579123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:15.579735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:15.586487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:15.586977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:15.587587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:15.588327 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:15.588812 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:15.589242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:15.721035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:15.729752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2f25dcdd-214e-47a7-a70a-411a9200b24a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.154476 Aug 12 12:26:15.730313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 509/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:15 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:16.751036 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:16.751671 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:16.754222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=27 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:16.758987 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:16.767504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:16.767504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:16.767504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:16.767504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:16.767905 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:16.893137 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:16.902049 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-faab3119-4115-4e9a-aa55-1543f104ec56 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.154923 Aug 12 12:26:16.902625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 499/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:16 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:17.924483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:17.925115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:17.927384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:17.932045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:17.932523 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:17.932999 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:17.933684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:17.934132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:17.934553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:17.937114 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=79 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:18.069238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:18.077705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5f19d1fb-65c9-4381-be06-8030629e863c tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.157280 Aug 12 12:26:18.078277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 510/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:17 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:19.099647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:19.100296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:19.107005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:19.107497 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:19.107935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:19.108633 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:19.109096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:19.109523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:19.239590 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:19.248004 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-78a9113d-dd4c-4539-858d-8ba4836f4b58 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.152388 Aug 12 12:26:19.248571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 500/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:19 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:20.270061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:20.270866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:20.277503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:20.278208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:20.278748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:20.279441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:20.279895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:20.280350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:20.418286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:20.427746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-50cb2723-f862-487c-a33c-d46f99f62d53 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.162285 Aug 12 12:26:20.428260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 511/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:20 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:21.025041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:21.027366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:21.034600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:21.035085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:21.035527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:21.036209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:21.036688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:21.037114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:21.194713 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5a78db52-83ca-43b9-b276-d38a7cb77ac8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "POST /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/action" status: 202 len: 0 microversion: 2.1 time: 0.173371 Aug 12 12:26:21.195345 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 501/1012] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:26:21 2022] POST /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:26:21.204203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:21.204872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:21.206719 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=4 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:21.211544 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:21.212029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:21.212462 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:21.213182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:21.213624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:21.214050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:21.361295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:21.369425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1ff99652-6062-40d9-aa35-3dc88f3cdb99 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1753 microversion: 2.1 time: 0.169781 Aug 12 12:26:21.369994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 512/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:21 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:21.452854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:21.453466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:21.459604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:21.460087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:21.460520 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:21.461274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:21.461728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:21.462152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:21.654374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:21.662326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bbfdc730-eba3-457b-8231-7e7a513a788f tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.214729 Aug 12 12:26:21.663035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 502/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:21 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:22.392213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:22.392781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:22.398701 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:22.399181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:22.399614 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:22.400296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:22.400778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:22.401202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:22.542740 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:22.551025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-25ef4e28-8de3-4f03-bddb-935b66bb6c87 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.163515 Aug 12 12:26:22.551600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 513/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:22 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:22.686008 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:22.686621 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:22.693097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:22.693836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:22.694271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:22.694957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:22.695407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:22.695830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:22.829389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:22.837391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-73e644ce-185f-42b6-8b5a-50eb1e3bb366 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.156170 Aug 12 12:26:22.837951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 503/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:22 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:23.573561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:23.574154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:23.580578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:23.581081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:23.581514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:23.582217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:23.582663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:23.583083 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:23.731577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:23.740245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-af3592d5-276e-4327-9ab2-e29276573dd3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.170574 Aug 12 12:26:23.740828 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 514/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:23 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:23.858410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:23.859018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:23.865341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:23.865822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:23.866251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:23.866927 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:23.867404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:23.867826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:23.994150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:24.002133 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-68c13a2d-211d-4ae3-936a-4f4d1e53420a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.147733 Aug 12 12:26:24.002684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 504/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:23 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:24.761230 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:24.761835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:24.768492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:24.769011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:24.769443 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:24.770131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:24.770658 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:24.770985 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:24.918556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:24.927249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-87176979-120c-40d0-a149-25e2446719bb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.169915 Aug 12 12:26:24.927814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 515/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:24 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:25.023547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:25.024104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:25.030455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:25.030945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:25.031382 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:25.032070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:25.033103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:25.033783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:25.160096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:25.167923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-df3b660e-cadb-42dd-b9c4-6145e22a61cd tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.148315 Aug 12 12:26:25.168488 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 505/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:25 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:25.948533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:25.949161 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:25.955841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:25.956305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:25.956766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:25.957467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:25.957911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:25.958344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:26.102574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:26.110389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-895e380e-b2bd-4d52-a40a-5a00437e3f5b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.165720 Aug 12 12:26:26.111460 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 516/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:25 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:26.190473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:26.191107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:26.198097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:26.198576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:26.199012 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:26.199689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:26.200142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:26.200568 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:26.333941 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:26.341974 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9afe9d9a-1da3-483d-8144-33d864d8600d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.155983 Aug 12 12:26:26.342544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 506/1022] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:26 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:27.132541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:27.133107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:27.139641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:27.140220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:27.140814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:27.141503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:27.141958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:27.142380 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:27.281466 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:27.289315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-52743c40-0731-40f2-b27e-fe393ef44875 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.160834 Aug 12 12:26:27.289879 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 517/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:27 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:27.363606 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:27.364408 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:27.370990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:27.371473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:27.371908 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:27.372609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:27.373070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:27.373495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:27.506828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:27.514744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-280e2a36-ff58-4cf3-b681-91139bf9c992 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.155186 Aug 12 12:26:27.515311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 507/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:27 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:28.310474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:28.311250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:28.321893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.322305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.323761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.329162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.329648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.330254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.482272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:28.492725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e99f2a46-5663-48e3-a35c-db0d3040ce47 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.186149 Aug 12 12:26:28.493507 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 518/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:28 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:28.540999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:28.541638 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:28.548400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.550091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.550526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.551222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.551668 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.552086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.613030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:28.613417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:28.619894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.620521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.620988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.621683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.622132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.622548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.651088 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cd8d3f60-ad3f-45ca-b77f-602f7a3f1bf0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6/ips" status: 200 len: 149 microversion: 2.1 time: 0.042264 Aug 12 12:26:28.651665 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 519/1026] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:26:28 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:26:28.665683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05fea730-1011-4d68-829d-02b01ece2712"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:28.668277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:28.674406 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.674870 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.675312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.676011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.676470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.676921 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.704426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:28.713654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-419fe680-0afa-4f71-8cef-61ecb72a1b26 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.180743 Aug 12 12:26:28.714312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 508/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:28 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:28.761986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Invalid volume: volume 05fea730-1011-4d68-829d-02b01ece2712 is already attached to instances: eb0081c4-5cc9-45f7-b6bb-558b73793525 Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: POST /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6/os-volume_attachments HTTP/1.1 Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 74 Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:26:28.764498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {"volumeAttachment": {"volumeId": "05fea730-1011-4d68-829d-02b01ece2712"}} Aug 12 12:26:28.766162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Invalid volume: volume 05fea730-1011-4d68-829d-02b01ece2712 is already attached to instances: eb0081c4-5cc9-45f7-b6bb-558b73793525 Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'server_id': 'cb10d887-ad82-4cbc-a00f-5fe01c3150b6', 'body': {'volumeAttachment': {'volumeId': '05fea730-1011-4d68-829d-02b01ece2712'}}} Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 05fea730-1011-4d68-829d-02b01ece2712 is already attached to instances: eb0081c4-5cc9-45f7-b6bb-558b73793525 Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:28.767160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 05fea730-1011-4d68-829d-02b01ece2712 is already attached to instances: eb0081c4-5cc9-45f7-b6bb-558b73793525 Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:28.769640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:28.771431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:28.771431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:26:28.771431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:26:28.771431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 05fea730-1011-4d68-829d-02b01ece2712 is already attached to instances: eb0081c4-5cc9-45f7-b6bb-558b73793525 Aug 12 12:26:28.771431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:28.771431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 400 to user: Invalid volume: volume 05fea730-1011-4d68-829d-02b01ece2712 is already attached to instances: eb0081c4-5cc9-45f7-b6bb-558b73793525 {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:26:28.771431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0b54cd09-2e2e-4847-8a93-ad98ac036f03 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104980 Aug 12 12:26:28.771431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 520/1028] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:26:28 2022] POST /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 12 12:26:28.777267 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:28.778426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:28.788704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.789195 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.789649 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.790334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:28.790781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:28.791200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:28.822682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:26:29.047971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3c0424f1-0869-4497-8e2b-1ba2c570641b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 204 len: 0 microversion: 2.1 time: 0.274325 Aug 12 12:26:29.048566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 509/1029] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:26:28 2022] DELETE /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:26:29.057448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:29.058429 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:29.064735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:29.065861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:29.066301 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:29.067028 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:29.067477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:29.067897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:29.195838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:29.203425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3ec3f0ed-979c-42dc-a95d-ad915e8c6a20 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1680 microversion: 2.1 time: 0.149730 Aug 12 12:26:29.203929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 521/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:29 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:29.518285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:29.518889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:29.524822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:29.525334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:29.525765 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:29.526451 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:29.526963 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:29.527377 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:29.675725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:29.683653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-afece020-4cd4-4f26-8381-2daf3c330bfe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.169688 Aug 12 12:26:29.684227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 510/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:29 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:29.735212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:29.735817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:29.742521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:29.743007 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:29.743462 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:29.744151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:29.744604 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:29.745062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:29.871492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:29.879810 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d10cf7a1-86fa-48b5-a5f1-64fb93f1e950 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.148547 Aug 12 12:26:29.880363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 522/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:29 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:30.226206 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:30.226818 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:30.233089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:30.233571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:30.234007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:30.234695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:30.235148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:30.235574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:30.239928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:30.364215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:30.371600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5d24817c-74f4-4885-9a7e-34b4cbbcfd9e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1680 microversion: 2.1 time: 0.149376 Aug 12 12:26:30.374106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 511/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:30 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:30.705546 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:30.706289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:30.712522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:30.713118 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:30.713635 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:30.714387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:30.714895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:30.715406 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:30.860280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:30.869086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bd4b3c3f-b4e0-42e7-918d-85159a6ea1bd tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.167401 Aug 12 12:26:30.869678 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 523/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:30 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:30.901122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:30.901725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:30.908011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:30.908489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:30.909485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:30.910171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:30.910617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:30.911038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:31.036751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:31.044651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bd1e8909-5f34-4fd7-b534-369f59c68b87 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.147302 Aug 12 12:26:31.045227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 512/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:30 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:31.393228 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:31.394693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:31.400849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:31.401333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:31.401767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:31.402452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:31.402900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:31.403322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:31.537050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:31.544430 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b8c0d138-7373-4b15-8af3-0b154502f5dc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1680 microversion: 2.1 time: 0.155045 Aug 12 12:26:31.545017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 524/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:31 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:31.890193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:31.890806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:31.897449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:31.897929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:31.898361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:31.899042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:31.899491 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:31.899918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:32.040250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:32.048107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-909c330c-2437-4ae6-a391-728a7ff2d9e6 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.161846 Aug 12 12:26:32.048695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 513/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:31 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:32.065350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:32.066034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:32.072631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:32.073149 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:32.073588 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:32.074282 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:32.074886 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:32.075323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:32.206405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:32.214286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bc17aef2-0dea-4ebf-9193-04e63f15ff1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.152864 Aug 12 12:26:32.214844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 525/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:32 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:32.565786 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:32.566405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:32.572844 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:32.573333 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:32.573763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:32.574442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:32.574892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:32.575311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:32.701773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:32.709089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ce961f9a-db97-4701-b9ef-41b02d7e8c85 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1680 microversion: 2.1 time: 0.147995 Aug 12 12:26:32.709650 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 514/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:32 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:33.069842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:33.070439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:33.076800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:33.077281 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:33.077711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:33.078386 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:33.078833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:33.079246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:33.220083 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:33.230169 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e7a011d9-8c2c-4b27-847e-ea579bae2860 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.163002 Aug 12 12:26:33.231052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 526/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:33 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:33.235291 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:33.235898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:33.242605 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:33.243088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:33.243521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:33.244203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:33.244665 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:33.245091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:33.375619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:33.383740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-222e77b4-1216-4d17-86b3-ab60ef0e11fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.152216 Aug 12 12:26:33.384307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 515/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:33 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:33.729449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:33.730061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:33.736147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:33.736680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:33.737182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:33.737927 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:33.738382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:33.738851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:33.742721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:33.866235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:33.873598 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2dc771ef-b1cb-408d-8874-0b72f0727dfb tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1680 microversion: 2.1 time: 0.148027 Aug 12 12:26:33.874167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 527/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:33 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:34.252095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:34.252730 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:34.259879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:34.260363 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:34.260853 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:34.261542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:34.261995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:34.262421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:34.404062 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:34.404716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:34.405337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:34.412291 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:34.416818 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ac83e30-7ddc-48d9-abe4-d20e2e2d8cfb tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.164407 Aug 12 12:26:34.416945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:34.416945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:34.417162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 516/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:34 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:34.417265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:34.417265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:34.417265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:34.575700 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:34.584572 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-26ae447b-e5f7-4ae2-bf0c-4b4ca3ffba89 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.183967 Aug 12 12:26:34.585265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 528/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:34 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:34.814435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-edd7ab71-b192-44a9-b8e9-ac543fb162bd req-b9669241-00fa-4f19-89b6-c693f1f20327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10d887-ad82-4cbc-a00f-5fe01c3150b6", "name": "network-vif-unplugged", "status": "completed", "tag": "8bf117fa-5b48-4608-9f3b-6d85c18200b4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:34.826959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-edd7ab71-b192-44a9-b8e9-ac543fb162bd req-b9669241-00fa-4f19-89b6-c693f1f20327 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:34.827447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-edd7ab71-b192-44a9-b8e9-ac543fb162bd req-b9669241-00fa-4f19-89b6-c693f1f20327 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:34.827877 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-edd7ab71-b192-44a9-b8e9-ac543fb162bd req-b9669241-00fa-4f19-89b6-c693f1f20327 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:34.840935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-edd7ab71-b192-44a9-b8e9-ac543fb162bd req-b9669241-00fa-4f19-89b6-c693f1f20327 service nova] Creating event network-vif-unplugged:8bf117fa-5b48-4608-9f3b-6d85c18200b4 for instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 on hv-cinder-79797 Aug 12 12:26:34.845933 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-edd7ab71-b192-44a9-b8e9-ac543fb162bd req-b9669241-00fa-4f19-89b6-c693f1f20327 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035135 Aug 12 12:26:34.852864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 517/1045] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:34.895781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:34.896384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:34.902428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:34.902915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:34.903344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:34.904024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:34.904500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:34.904942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:35.372036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:35.380145 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a076fe6c-77a7-4246-a67e-f272f0463e6e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1680 microversion: 2.1 time: 0.488980 Aug 12 12:26:35.380727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 529/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:34 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1680 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:35.435375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:35.436684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:35.443744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:35.444280 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:35.445018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:35.445723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:35.446198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:35.446620 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:35.607225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:35.607840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:35.623594 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:35.624029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:35.624518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:35.624982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:35.625683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:35.626136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:35.626563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:35.633244 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-efb99ed1-5a18-4666-9fb0-c31a7f9975d7 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.202455 Aug 12 12:26:35.644867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 518/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:35 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:35.816968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:35.825338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b1585093-0653-47f5-8321-85a091813247 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.222032 Aug 12 12:26:35.826104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 530/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:35 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:35.963961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-31aba0e8-9118-4aec-a822-082381c7a9e3 req-16a8b42c-aadc-44a8-84ce-7867a57cb6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10d887-ad82-4cbc-a00f-5fe01c3150b6", "name": "network-vif-deleted", "tag": "8bf117fa-5b48-4608-9f3b-6d85c18200b4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:35.974566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-31aba0e8-9118-4aec-a822-082381c7a9e3 req-16a8b42c-aadc-44a8-84ce-7867a57cb6f7 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:35.975093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-31aba0e8-9118-4aec-a822-082381c7a9e3 req-16a8b42c-aadc-44a8-84ce-7867a57cb6f7 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:35.975579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-31aba0e8-9118-4aec-a822-082381c7a9e3 req-16a8b42c-aadc-44a8-84ce-7867a57cb6f7 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:35.987092 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-31aba0e8-9118-4aec-a822-082381c7a9e3 req-16a8b42c-aadc-44a8-84ce-7867a57cb6f7 service nova] Creating event network-vif-deleted:8bf117fa-5b48-4608-9f3b-6d85c18200b4 for instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 on hv-cinder-79797 Aug 12 12:26:35.992924 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-31aba0e8-9118-4aec-a822-082381c7a9e3 req-16a8b42c-aadc-44a8-84ce-7867a57cb6f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Aug 12 12:26:35.993520 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 519/1049] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:36.401833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:36.402837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:36.409120 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:36.409678 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:36.411077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:36.411864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:36.412398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:36.413065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:36.478368 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:36.485922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a7d4dc15-f267-4744-b903-53a503b636bf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1326 microversion: 2.1 time: 0.088125 Aug 12 12:26:36.486497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 531/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:36 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1326 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:36.656724 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:36.658189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:36.665286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:36.665921 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:36.666455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:36.667389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:36.668039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:36.668563 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:36.848163 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:36.851844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:36.859272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:36.859482 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:36.860512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:36.861000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:36.861732 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:36.862365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:36.862794 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:36.874699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c9db7477-1eee-4678-853f-b9361eb07eda tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.221700 Aug 12 12:26:36.874699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 520/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:36 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:37.007525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:37.015550 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e9052687-3942-40a6-9cd6-59640fc5692e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1736 microversion: 2.1 time: 0.172726 Aug 12 12:26:37.016115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 532/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:36 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:37.506588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:37.507194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:37.513320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:37.513806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:37.514248 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:37.514963 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:37.515420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:37.515851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:37.546647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:37.547134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:37.547601 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:37.548055 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lazy-loading 'fault' on Instance uuid cb10d887-ad82-4cbc-a00f-5fe01c3150b6 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:26:37.588955 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:37.596503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a8b05a80-0745-4365-ab07-082b612e5e06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 200 len: 1331 microversion: 2.1 time: 0.094530 Aug 12 12:26:37.597206 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 521/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:37 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:37.896777 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:37.897413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:37.903753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:37.904235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:37.904692 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:37.905382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:37.905859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:37.906258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.038364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:38.039327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:38.045804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.046302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.046717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.047406 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.047864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.048289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.059374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:38.068258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5429fc93-e8a5-439c-9337-d907c615ca66 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.176233 Aug 12 12:26:38.069089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 533/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:37 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:38.176925 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:38.184743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-09c8724a-c4d5-43c7-a1e7-c7f0af5fa3f3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1716 microversion: 2.1 time: 0.151741 Aug 12 12:26:38.185301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 522/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:38 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:38.292417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:38.292945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:38.298731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.299205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.299639 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.300313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.300852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.301252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.384165 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] HTTP exception thrown: Cannot 'detach_volume' instance 836dc0f4-7d00-4730-9828-909cded7ec39 while it is in vm_state rescued Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Request method failure captured: Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments/203ead5c-8cf3-4a72-b57d-6af7be21e7d0 HTTP/1.1 Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU1XxsYk5VN_T93GFCyU7RYD5hJ0BUvCvlf_XfH6CNe7so5BnwxxiAMNAPR3AFdodLdusZpG2dRuzFwRh-WoYlJ9uzjtmndJ9XnlnxpvjQSOcEwevrL5RQryb0o3Z3JjmOG4-zKB_4aZsdhzluBi1_8emtWcCSYZ8JlpKE6IFVAs9c Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:26:38.386063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e8def85acdd4e308bb51b4063c2ab4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}] Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 099b87a6c6b8409ab188c0b71ded7f55 Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:26:38.387445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Cannot 'detach_volume' instance 836dc0f4-7d00-4730-9828-909cded7ec39 while it is in vm_state rescued Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'server_id': '836dc0f4-7d00-4730-9828-909cded7ec39', 'id': '203ead5c-8cf3-4a72-b57d-6af7be21e7d0'} Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 836dc0f4-7d00-4730-9828-909cded7ec39 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:26:38.388170 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 836dc0f4-7d00-4730-9828-909cded7ec39 while it is in vm_state rescued Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 836dc0f4-7d00-4730-9828-909cded7ec39 while it is in vm_state rescued Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.389431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Returning 409 to user: Cannot 'detach_volume' instance 836dc0f4-7d00-4730-9828-909cded7ec39 while it is in vm_state rescued {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:26:38.390398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d92e1d9d-841e-4489-a794-40f745d0cc0e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments/203ead5c-8cf3-4a72-b57d-6af7be21e7d0" status: 409 len: 152 microversion: 2.1 time: 0.099001 Aug 12 12:26:38.390398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 534/1056] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:26:38 2022] DELETE /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments/203ead5c-8cf3-4a72-b57d-6af7be21e7d0 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 12 12:26:38.397883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:38.399226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:38.404517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.405050 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.405531 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.406228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.406675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.407094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.618006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:38.618507 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:38.624511 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.625043 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.625476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.626153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.626600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.627017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.640131 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-83d81d1a-df5a-402a-b5e7-4ff39a6115a6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "POST /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/action" status: 202 len: 0 microversion: 2.1 time: 0.246558 Aug 12 12:26:38.640912 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:26:38.648790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 523/1057] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:26:38 2022] POST /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 HTTP/1.1 Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:26:38.648924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:26:38.650455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'cb10d887-ad82-4cbc-a00f-5fe01c3150b6'} Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:26:38.651321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:26:38.652896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:38.654119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:26:38.654119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ac4fa3ab-f206-4d83-8043-f6e6d3f0ae94 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 404 len: 111 microversion: 2.1 time: 0.029815 Aug 12 12:26:38.654119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 535/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:38 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:26:38.654361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:38.654361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:38.656160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7db95a57-b8c4-4e50-b8df-dd34d75a5e91 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '.version_select at 0x7f9914294160>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:38.666401 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.666900 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.667336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.668022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:38.668458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:38.668907 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:38.781527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7db95a57-b8c4-4e50-b8df-dd34d75a5e91 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118254632" status: 202 len: 0 microversion: 2.1 time: 0.132109 Aug 12 12:26:38.782139 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 536/1059] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 12 12:26:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118254632 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 12:26:38.870430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:38.878411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7b562d3c-ace8-4281-80eb-b008b13d830a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1724 microversion: 2.1 time: 0.232106 Aug 12 12:26:38.879873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 524/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:38 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:39.091010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:39.091623 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:39.099192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:39.099668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:39.100099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:39.101058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:39.101252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:39.101674 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:39.338729 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:39.348305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ef5e615b-ac2e-4c9e-ad3d-b0e8c9c427b5 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.261069 Aug 12 12:26:39.349075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 537/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:39 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:39.638128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-308388402", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1386494864", "security_groups": [{"name": "tempest-secgroup-smoke-1845293560"}], "block_device_mapping_v2": [{"uuid": "f9303369-470e-4728-aa86-6fa93e938af7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "34bda1c6-3fac-4d1d-b2d0-884ebbdd299a"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:39.734686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:39.735173 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:39.742091 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:39.742565 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:39.742999 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:39.743736 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:39.744187 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:39.744604 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:39.756894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] validate_networks() for [('34bda1c6-3fac-4d1d-b2d0-884ebbdd299a', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:26:39.829979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lazy-loading 'services' on Instance uuid eb0081c4-5cc9-45f7-b6bb-558b73793525 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:26:40.026691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b05abe91-6eaf-487b-9fdc-fe54004b8cd3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments/05fea730-1011-4d68-829d-02b01ece2712" status: 202 len: 0 microversion: 2.1 time: 0.295717 Aug 12 12:26:40.027290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 538/1062] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:26:39 2022] DELETE /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments/05fea730-1011-4d68-829d-02b01ece2712 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 12:26:40.032280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:40.033012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:40.039529 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:40.040887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:40.040887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:40.041176 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:40.041841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:40.042268 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:40.185910 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:26:40.186351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:26:40.186814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:26:40.187212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:26:40.187614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:26:40.197370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:40.197855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:40.198306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:40.199011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:40.199463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:40.199886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:40.217103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Getting quotas for project 566d2428ccbe41888b9619faf5f212a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:26:40.219163 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:40.221132 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Getting quotas for user a90e3591b4144fdfb8b5ed5391aec7c6 and project 566d2428ccbe41888b9619faf5f212a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:26:40.227447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-91403fef-dac2-4d76-8348-bc1d7b00db41 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1724 microversion: 2.1 time: 0.199044 Aug 12 12:26:40.228021 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 539/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:40 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:40.241815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:40.241815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:40.242198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:40.242691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:40.243128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:40.243821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:40.244279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:40.244733 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:40.276676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-afb542be-c39a-4d3a-9f51-3814b396887a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047420 Aug 12 12:26:40.277245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 540/1064] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:26:40 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:40.281019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:26:40.283063 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9303369-470e-4728-aa86-6fa93e938af7',volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:26:40.370264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:40.370862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:40.376712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:40.377186 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:40.377616 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:40.378280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:40.378747 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:40.379279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:40.522137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:40.530271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-234b076a-530e-48ed-a90d-5b06462303d1 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.163909 Aug 12 12:26:40.530849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 541/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:40 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:40.633476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8ec781db-77a4-4bd4-a7e6-a942b4a3c27b tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999180 Aug 12 12:26:40.634341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 525/1066] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:26:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:26:40.646370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ca21549c-6440-4093-8dd9-d3c953198303 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:40.647088 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ca21549c-6440-4093-8dd9-d3c953198303 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:40.700371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ca21549c-6440-4093-8dd9-d3c953198303 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:40.707835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ca21549c-6440-4093-8dd9-d3c953198303 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1094 microversion: 2.1 time: 0.066022 Aug 12 12:26:40.708427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 542/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:40 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:41.249591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:41.250189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:41.257949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:41.258410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:41.258842 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:41.259527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:41.259972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:41.260393 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:41.290195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:41.292567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:41.300197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:41.301478 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:41.301985 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:41.302701 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:41.303157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:41.303584 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:41.333047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-53c7d6a1-2827-489e-9066-4e8f45a28a0e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046413 Aug 12 12:26:41.333622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 543/1068] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:26:41 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:26:41.393222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:41.401536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-27942000-cb11-4c74-a748-7936353df1ea tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1724 microversion: 2.1 time: 0.156345 Aug 12 12:26:41.405083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 526/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:41 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:41.551812 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:41.552423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:41.558285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:41.558765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:41.559197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:41.559878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:41.560328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:41.560880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:41.701379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:41.710394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b24da879-1ccc-4004-9e7f-5602eb87ee4e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1758 microversion: 2.1 time: 0.163005 Aug 12 12:26:41.710977 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 544/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:41 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:41.729981 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:41.730585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:41.736855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:41.737249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:41.737686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:41.738480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:41.739101 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:41.739867 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:41.803417 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:41.811108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ab8e86a4-e737-4e39-8b3a-eab048ff80e9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1144 microversion: 2.1 time: 0.084944 Aug 12 12:26:41.811521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 527/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:41 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:42.345305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:42.347477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:42.354043 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:42.354522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:42.354958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:42.355651 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:42.356102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:42.356526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:42.382237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:42.386700 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3ca0291f-d737-47db-8cd4-5582d13e0b21 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Aug 12 12:26:42.387252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 545/1072] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:26:42 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:42.422650 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:42.423253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:42.430804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:42.431350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:42.431779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:42.432456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:42.432984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:42.433460 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:42.453093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:42.569470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:42.578182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e5eaf0e2-db93-4bec-9591-ec86eb7fa239 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1724 microversion: 2.1 time: 0.159393 Aug 12 12:26:42.578760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 528/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:42 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:42.734081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:42.734689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:42.741388 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:42.741862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:42.742324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:42.742992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:42.743434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:42.743877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:42.831757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:42.841565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:42.841565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:42.841565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:42.841565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:42.841967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:42.841967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:42.841967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:42.898853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:42.907021 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9f871463-41fc-4b70-b979-0501fa5d66f0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1761 microversion: 2.1 time: 0.177306 Aug 12 12:26:42.907680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 546/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:42 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1761 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:42.914440 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:42.922002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cb306734-902d-4476-9658-49b5dedde52f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1144 microversion: 2.1 time: 0.094589 Aug 12 12:26:42.927541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 529/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:42 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:43.399216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:43.401427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:43.407782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:43.408266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:43.408737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:43.409463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:43.409920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:43.410359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:43.440238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-29f26950-83f7-4eab-8cf2-870f5cdfe183 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Aug 12 12:26:43.440821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 547/1076] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:26:43 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:43.599255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:43.600604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:43.607180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:43.613319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:43.613319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:43.613319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:43.613319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:43.614227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:43.754411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:43.762509 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2fd8c067-275d-4acf-aeee-63165b46fd04 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1730 microversion: 2.1 time: 0.167133 Aug 12 12:26:43.765367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 530/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:43 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:43.783517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:43.784016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:43.791053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:43.795753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:43.795753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:43.795753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:43.795753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:43.796168 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:43.871780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-446e4895-3a5d-4ac6-af1a-a3893e31aaaa tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092657 Aug 12 12:26:43.872379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 548/1078] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 12 12:26:43 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:43.947419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:43.948033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:43.954061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:43.954542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:43.954975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:43.955660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:43.956109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:43.956533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:44.017354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:44.025955 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5ab4f71a-51b6-49dc-aad3-cd0612a1c887 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1192 microversion: 2.1 time: 0.082966 Aug 12 12:26:44.026533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 531/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:43 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:44.453892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:44.456037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:44.463152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:44.463571 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:44.464014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:44.464843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:44.465306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:44.465736 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:44.496364 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f7cb7e7b-9701-4abd-b379-64728536b354 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Aug 12 12:26:44.497184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 549/1080] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:26:44 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:44.791706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-2563da1a-11e7-4a53-ae11-72774e394dc0 req-1f395386-9fc5-4031-b282-c70b6658cf91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836dc0f4-7d00-4730-9828-909cded7ec39", "tag": "30720ab8-0d22-48fe-b3f3-2941ca200322"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:44.811521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2563da1a-11e7-4a53-ae11-72774e394dc0 req-1f395386-9fc5-4031-b282-c70b6658cf91 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:44.812233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2563da1a-11e7-4a53-ae11-72774e394dc0 req-1f395386-9fc5-4031-b282-c70b6658cf91 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:44.812888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2563da1a-11e7-4a53-ae11-72774e394dc0 req-1f395386-9fc5-4031-b282-c70b6658cf91 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:44.827055 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-2563da1a-11e7-4a53-ae11-72774e394dc0 req-1f395386-9fc5-4031-b282-c70b6658cf91 service nova] Creating event network-changed:30720ab8-0d22-48fe-b3f3-2941ca200322 for instance 836dc0f4-7d00-4730-9828-909cded7ec39 on hv-cinder-79797 Aug 12 12:26:44.832353 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-2563da1a-11e7-4a53-ae11-72774e394dc0 req-1f395386-9fc5-4031-b282-c70b6658cf91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044401 Aug 12 12:26:44.833045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 532/1081] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:45.047417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:45.048069 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:45.055203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.059473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.059473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.059473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.059473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.060293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.139005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:45.146967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c91b773b-f622-426b-bed3-0c7012002175 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1192 microversion: 2.1 time: 0.103612 Aug 12 12:26:45.147755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 550/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:45 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:45.510769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:45.513615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:45.520457 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.521145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.522238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.522908 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.523361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.523797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.586653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3e4319a4-894d-444e-9644-91aa589d5165 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081263 Aug 12 12:26:45.595181 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 533/1083] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:26:45 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:26:45.657624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:45.658297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:45.665159 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.665930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.666054 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.667019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.667364 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.667787 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.698790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Going to try to terminate instance {{(pid=121154) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:26:45.749864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:45.750494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:45.759598 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.762257 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.762929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.763654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.764141 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.764569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.799759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-690b8d8f-a3d5-44b2-8db0-cc49f662738c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments/c624a930-c67e-40be-9679-e1eaeb2e113d" status: 200 len: 194 microversion: 2.20 time: 0.063820 Aug 12 12:26:45.806779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 534/1084] 10.222.0.27 () {60 vars in 1454 bytes} [Fri Aug 12 12:26:45 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments/c624a930-c67e-40be-9679-e1eaeb2e113d => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:26:45.879717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:45.880499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:45.890185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.890801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.891369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.892235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.892819 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.893376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.946095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6c4212df-31a0-4ad1-85e4-a1f6636ee068 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 204 len: 0 microversion: 2.1 time: 0.291828 Aug 12 12:26:45.946907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 551/1085] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:26:45 2022] DELETE /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:26:45.955532 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:45.956223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:45.962441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.962922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.963504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:45.964197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:45.964667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:45.965097 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:46.025742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lazy-loading 'services' on Instance uuid 87e50626-b455-4357-8ab1-4ed9dea35297 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:26:46.192410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:46.201090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d234d200-b80c-49e3-841c-10fca1b8ff0b tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1679 microversion: 2.1 time: 0.249729 Aug 12 12:26:46.201745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 552/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:45 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:46.206445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:46.207259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:46.213130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:46.218143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:46.218143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:46.218143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:46.218143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:46.218530 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:46.266793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a3b9d0e2-a2e5-414d-b4f0-5c063c0ce79b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments/c624a930-c67e-40be-9679-e1eaeb2e113d" status: 202 len: 0 microversion: 2.20 time: 0.390838 Aug 12 12:26:46.267504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 535/1087] 10.222.0.27 () {60 vars in 1457 bytes} [Fri Aug 12 12:26:45 2022] DELETE /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments/c624a930-c67e-40be-9679-e1eaeb2e113d => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 12 12:26:46.276940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:46.279268 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:46.286202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:46.286693 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:46.287202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:46.288301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:46.288794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:46.289226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:46.324326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f043b8a8-4e01-414e-b47a-53f12a2bfe51 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052029 Aug 12 12:26:46.324952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 536/1088] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Aug 12 12:26:46 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 12:26:46.562089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:46.576111 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1992c506-4686-43c7-866c-7d95a0615e59 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1210 microversion: 2.1 time: 0.373050 Aug 12 12:26:46.577601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 553/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:46 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1210 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:46.846980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-656f6e35-670e-4ccf-9749-47258b4d20e3 req-e8951718-d878-4076-9c41-526936ff364e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836dc0f4-7d00-4730-9828-909cded7ec39", "tag": "30720ab8-0d22-48fe-b3f3-2941ca200322"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:46.852773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:46.857940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-656f6e35-670e-4ccf-9749-47258b4d20e3 req-e8951718-d878-4076-9c41-526936ff364e service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:46.858559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-656f6e35-670e-4ccf-9749-47258b4d20e3 req-e8951718-d878-4076-9c41-526936ff364e service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:46.858996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-656f6e35-670e-4ccf-9749-47258b4d20e3 req-e8951718-d878-4076-9c41-526936ff364e service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:46.871113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-656f6e35-670e-4ccf-9749-47258b4d20e3 req-e8951718-d878-4076-9c41-526936ff364e service nova] Creating event network-changed:30720ab8-0d22-48fe-b3f3-2941ca200322 for instance 836dc0f4-7d00-4730-9828-909cded7ec39 on hv-cinder-79797 Aug 12 12:26:46.876035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-656f6e35-670e-4ccf-9749-47258b4d20e3 req-e8951718-d878-4076-9c41-526936ff364e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032668 Aug 12 12:26:46.876663 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 537/1090] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:47.222382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:47.222994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:47.230082 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:47.230564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:47.231002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:47.231691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:47.232145 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:47.232572 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:47.338704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:47.340852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:47.347893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:47.348376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:47.353243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:47.353243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:47.353243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:47.353243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:47.361951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:47.369986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-18cd04d6-2af0-42df-bbbc-773c400da2e6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1679 microversion: 2.1 time: 0.151402 Aug 12 12:26:47.370916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 554/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:47 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:47.388669 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dabe56d2-31a1-4fb0-beb9-956ed4ff85c1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055267 Aug 12 12:26:47.389245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 538/1092] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Aug 12 12:26:47 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 12:26:47.599215 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:47.599777 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:47.601790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:47.606491 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:47.606969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:47.607405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:47.608099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:47.608546 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:47.608993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:47.832260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:47.844922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-18976c6c-ef99-4c69-aeb9-ec9247a4a633 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1278 microversion: 2.1 time: 0.245177 Aug 12 12:26:47.844922 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 555/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:47 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:48.393134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:48.397649 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:48.405317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:48.407838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:48.408775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:48.409485 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:48.410851 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:48.411810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:48.413463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:48.415456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:48.420190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:48.420711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:48.421305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:48.422011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:48.422635 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:48.423196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:48.489477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-169b8936-60d6-4be0-ab76-021c1b6834e7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088190 Aug 12 12:26:48.491750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 556/1094] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Aug 12 12:26:48 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 12:26:48.734656 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:48.742119 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-be39bbff-18db-4c29-aac3-49f8fff60bcf tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1679 microversion: 2.1 time: 0.354197 Aug 12 12:26:48.742725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 539/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:48 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1679 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:48.843763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-ca48da23-e765-4807-8fb3-fcbf18fe72e5 req-00c6851a-1e98-49b8-bf5a-c9151a22291c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246a125c-dd37-4c1c-880b-b7ddf37ebd11", "tag": "54968b04-455b-4d52-ab10-345d319d9a7d"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:48.858048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ca48da23-e765-4807-8fb3-fcbf18fe72e5 req-00c6851a-1e98-49b8-bf5a-c9151a22291c service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:48.858527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ca48da23-e765-4807-8fb3-fcbf18fe72e5 req-00c6851a-1e98-49b8-bf5a-c9151a22291c service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:48.859001 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ca48da23-e765-4807-8fb3-fcbf18fe72e5 req-00c6851a-1e98-49b8-bf5a-c9151a22291c service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:48.861749 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:48.862465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:48.871330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:48.872774 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:48.873519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:48.874054 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-ca48da23-e765-4807-8fb3-fcbf18fe72e5 req-00c6851a-1e98-49b8-bf5a-c9151a22291c service nova] Creating event network-changed:54968b04-455b-4d52-ab10-345d319d9a7d for instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 on hv-cinder-79797 Aug 12 12:26:48.875051 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:48.875702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:48.877591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:48.881874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-ca48da23-e765-4807-8fb3-fcbf18fe72e5 req-00c6851a-1e98-49b8-bf5a-c9151a22291c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040285 Aug 12 12:26:48.882446 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 557/1096] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:49.079274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-b10e9e90-f6c0-46d8-b4f4-65d51f45c888 req-4bdb4c8d-ff3b-4f2f-8096-0827c1cb5ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0081c4-5cc9-45f7-b6bb-558b73793525", "name": "network-vif-deleted", "tag": "05451aeb-84cb-4518-9499-706bfa3f9ff9"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:49.091650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b10e9e90-f6c0-46d8-b4f4-65d51f45c888 req-4bdb4c8d-ff3b-4f2f-8096-0827c1cb5ac2 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.092263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b10e9e90-f6c0-46d8-b4f4-65d51f45c888 req-4bdb4c8d-ff3b-4f2f-8096-0827c1cb5ac2 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.092834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b10e9e90-f6c0-46d8-b4f4-65d51f45c888 req-4bdb4c8d-ff3b-4f2f-8096-0827c1cb5ac2 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.105033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-b10e9e90-f6c0-46d8-b4f4-65d51f45c888 req-4bdb4c8d-ff3b-4f2f-8096-0827c1cb5ac2 service nova] Creating event network-vif-deleted:05451aeb-84cb-4518-9499-706bfa3f9ff9 for instance eb0081c4-5cc9-45f7-b6bb-558b73793525 on hv-cinder-79797 Aug 12 12:26:49.111144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-b10e9e90-f6c0-46d8-b4f4-65d51f45c888 req-4bdb4c8d-ff3b-4f2f-8096-0827c1cb5ac2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035922 Aug 12 12:26:49.111993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 558/1097] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:26:49.144568 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:49.159670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e10c3ef0-4ef4-46a6-845b-91a1364195f1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.302308 Aug 12 12:26:49.162193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 540/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:48 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:49.499837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:49.502113 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:49.509583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.510063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.510494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.511190 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.511637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.512063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.544308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-229b73e8-4257-47f7-9a88-e36612361561 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048868 Aug 12 12:26:49.545165 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 559/1099] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Aug 12 12:26:49 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:49.615184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:49.615734 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:49.622192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.622701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.623135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.623828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.624307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.624753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.650790 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:26:49.763751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:49.764454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:49.770720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.771205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.771802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.772554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.773260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.773693 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.807371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.807784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.808223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.808699 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lazy-loading 'fault' on Instance uuid eb0081c4-5cc9-45f7-b6bb-558b73793525 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:26:49.854669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:49.862486 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b545c6ed-83cf-4450-b3f8-3c388e15c2ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1330 microversion: 2.1 time: 0.102596 Aug 12 12:26:49.867336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 560/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:49 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:49.889007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0ac63cad-6c66-46a7-a444-77d58b7edf73 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 204 len: 0 microversion: 2.20 time: 0.277498 Aug 12 12:26:49.893274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 541/1101] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Aug 12 12:26:49 2022] DELETE /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 12:26:49.899473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:49.900108 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:49.906975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.907598 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.907887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:49.908583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:49.909089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:49.909512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:50.076846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:50.083558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:50.085812 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:50.087216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0fe4e870-7a49-4310-86c4-9a799a8c9107 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.192721 Aug 12 12:26:50.087917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 561/1102] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:26:49 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:26:50.181273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:50.182072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:50.188399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:50.189011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:50.189446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:50.190172 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:50.190616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:50.191034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:50.207590 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:50.228259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:50.325936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:50.333654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-aa113fb9-aef2-4306-9f1a-042adcc5dba6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.157087 Aug 12 12:26:50.334771 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 542/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:50 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:50.884262 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:50.884891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:50.887296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:50.892055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:50.892530 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:50.892990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:50.893667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:50.894108 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:50.894523 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:50.898551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:50.924440 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:50.924952 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:50.925384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:50.925822 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lazy-loading 'fault' on Instance uuid eb0081c4-5cc9-45f7-b6bb-558b73793525 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:26:50.967400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:50.975135 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6bb0c83f-641a-4a6c-a78d-74a3a5631950 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 200 len: 1330 microversion: 2.1 time: 0.094902 Aug 12 12:26:50.975698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 562/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:50 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:51.111593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:51.112096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:51.119080 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:51.119954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:51.120390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:51.121164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:51.121609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:51.122026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:51.252816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:51.260766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:51.262441 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:51.263606 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1a326042-43aa-4585-b3e7-69c0b9f9debe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.156300 Aug 12 12:26:51.264174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 543/1105] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:26:51 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:26:51.355635 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:51.356282 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:51.362595 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:51.363014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:51.363442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:51.364117 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:51.364561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:51.365011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:51.575976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:51.583357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-583c933c-d5ef-4821-ba21-c522c9214734 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.231999 Aug 12 12:26:51.583911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 563/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:51 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:51.995593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:51.996196 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:52.002106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:52.002580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:52.003006 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:52.003679 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:52.004122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:52.004540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:52.009032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:26:52.017994 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 HTTP/1.1 Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:26:52.019587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:26:52.021236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'eb0081c4-5cc9-45f7-b6bb-558b73793525'} Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:26:52.022872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:26:52.024414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:26:52.026307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:26:52.026307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6f80a0a3-cddf-43bc-b47c-3602144d14d8 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 404 len: 111 microversion: 2.1 time: 0.029255 Aug 12 12:26:52.026307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 544/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:51 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:26:52.030453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-88976c01-739d-4521-a400-4c6be1b0d028 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '.version_select at 0x7f990ef09c10>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:52.159511 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-88976c01-739d-4521-a400-4c6be1b0d028 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807119452" status: 202 len: 0 microversion: 2.1 time: 0.132781 Aug 12 12:26:52.160099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 564/1108] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Aug 12 12:26:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807119452 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:26:52.288626 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:52.289234 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:52.295985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:52.296463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:52.298190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:52.298190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:52.298190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:52.298503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:52.542293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:52.550289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:52.567951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:52.567951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d48fcc8d-68e0-4e22-b0f6-2690802aec04 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1725 microversion: 2.20 time: 0.269850 Aug 12 12:26:52.567951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 545/1109] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:26:52 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1725 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:26:52.604057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:52.604690 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:52.610691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:52.611172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:52.611607 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:52.612291 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:52.612771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:52.613194 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:52.824058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:52.831742 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bce1f467-cf6d-4732-9464-09571f76c710 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.231666 Aug 12 12:26:52.832305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 565/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:52 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:52.982972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e630ed8a-3b9e-4445-a444-b0a2c75fd1f9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: .version_select at 0x7f9914062ee0>, body: {"keypair": {"name": "tempest-keypair-863347557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV3kv/xuNimfR8v3OUzAiqCScAkx61+qkLkckzMTUKLUjQYgp+1vu7Jm7Ifpx8saySQjhfGMa8qkRzqL3tzJOa/JkVAED/ZD/eGd5ae2SJx/UTnJUgU7RYobH/OT+DaVg=="}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:52.999644 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-e630ed8a-3b9e-4445-a444-b0a2c75fd1f9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:26:53.003384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-e630ed8a-3b9e-4445-a444-b0a2c75fd1f9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for user 0156c689e109489d9265dd3dd4d5cfde and project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:26:53.086138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e630ed8a-3b9e-4445-a444-b0a2c75fd1f9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106895 Aug 12 12:26:53.086800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 546/1111] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:26:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:53.575851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:53.576450 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:53.582306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:53.582780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:53.583210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:53.583888 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:53.584369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:53.584820 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:53.674793 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:53.687869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:53.687869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:53.687869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d002e715-996e-41b2-ad22-2077b311012a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1657 microversion: 2.20 time: 0.114071 Aug 12 12:26:53.688166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 566/1112] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:26:53 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1657 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:26:53.854521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:53.855130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:53.861602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:53.862011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:53.862443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:53.863143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:53.863600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:53.864019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:54.173258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:54.183034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-37e3d100-9816-478e-825b-e78196e7aec8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.332685 Aug 12 12:26:54.183034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 547/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:53 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:54.296997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-badeed39-2876-4318-b593-88ee39a4d1f0 req-1df1ad67-08d6-4f58-9319-8190f4ed88f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e50626-b455-4357-8ab1-4ed9dea35297", "name": "network-vif-deleted", "tag": "ea96cc24-3c69-42d6-a3cc-6f2a132e8057"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:54.306623 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-badeed39-2876-4318-b593-88ee39a4d1f0 req-1df1ad67-08d6-4f58-9319-8190f4ed88f3 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:54.307094 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-badeed39-2876-4318-b593-88ee39a4d1f0 req-1df1ad67-08d6-4f58-9319-8190f4ed88f3 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:54.307520 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-badeed39-2876-4318-b593-88ee39a4d1f0 req-1df1ad67-08d6-4f58-9319-8190f4ed88f3 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:54.319771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-badeed39-2876-4318-b593-88ee39a4d1f0 req-1df1ad67-08d6-4f58-9319-8190f4ed88f3 service nova] Creating event network-vif-deleted:ea96cc24-3c69-42d6-a3cc-6f2a132e8057 for instance 87e50626-b455-4357-8ab1-4ed9dea35297 on hv-cinder-79797 Aug 12 12:26:54.325014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-badeed39-2876-4318-b593-88ee39a4d1f0 req-1df1ad67-08d6-4f58-9319-8190f4ed88f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031582 Aug 12 12:26:54.325618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 567/1114] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:26:54.711675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:54.712426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:54.719592 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:54.720142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:54.720611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:54.721347 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:54.721830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:54.722470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:54.756376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:54.757049 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:54.757649 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:54.758175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lazy-loading 'fault' on Instance uuid 87e50626-b455-4357-8ab1-4ed9dea35297 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:26:54.811093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:54.820272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:54.823546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:54.823546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eb3824af-fab6-46f0-b265-8dd4578808ae tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 200 len: 1372 microversion: 2.20 time: 0.115685 Aug 12 12:26:54.824071 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 548/1115] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:26:54 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:26:55.204419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:55.205135 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:55.211646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:55.212250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:55.212798 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:55.213524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:55.214098 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:55.214709 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:55.369385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:55.386348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-85d514f2-2dec-4ee6-b9b3-700a93f06f74 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.186644 Aug 12 12:26:55.386927 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 568/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:55 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:55.504421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2062194440", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ab29f31-7915-471c-8e03-8b38ddd1a049"}], "security_groups": [{"name": "tempest-securitygroup--387050270"}], "key_name": "tempest-keypair-863347557", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:55.607219 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] validate_networks() for [('9ab29f31-7915-471c-8e03-8b38ddd1a049', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:26:55.846215 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:55.846818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:55.853452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:55.853932 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:55.854370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:55.855055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:55.855501 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:55.855923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:55.869826 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] HTTP exception thrown: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Request method failure captured: Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 HTTP/1.1 Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU5XPnMW9-eALJl7wMyMdczmMW7EVwTbj4feMC4hjWjslI76L-uLmOoaaGBKNW7_MzMzQorf6gat_S56weKjDimpzJ_z5Zo3QWoIZEFmQkz6mefeE4npXetDz29SqhEfRmLRPIP1vvokTTv3AlofE3VEmAsIHLo8Do1HaqmjrqRzAY Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:26:55.871496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f84d5684e1904e569a5551b9e21ce0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}] Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 383cbf83186747a5b81a12ed5288c39a Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:26:55.873202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '87e50626-b455-4357-8ab1-4ed9dea35297'} Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:26:55.874142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:26:55.875636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:26:55.877691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Returning 404 to user: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:26:55.877691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-462ae17d-1d2c-40ad-91f1-106c0f38b4c7 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 404 len: 111 microversion: 2.20 time: 0.030612 Aug 12 12:26:55.877691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 569/1117] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:26:55 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 12 12:26:55.881564 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-55b6a97a-d479-4b8e-8859-253ba0c7ba2b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '.version_select at 0x7f990efe1b80>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:55.943299 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-55b6a97a-d479-4b8e-8859-253ba0c7ba2b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251810353" status: 204 len: 0 microversion: 2.20 time: 0.065304 Aug 12 12:26:55.944079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 570/1118] 10.222.0.27 () {60 vars in 1262 bytes} [Fri Aug 12 12:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251810353 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 12 12:26:55.974569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:26:55.976182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:26:55.976667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:26:55.977087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:26:55.977715 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:26:55.986465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:55.986943 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:55.987374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:55.988098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:55.988541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:55.988993 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:56.005381 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:26:56.009960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for user 0156c689e109489d9265dd3dd4d5cfde and project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:26:56.021529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:26:56.024562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:26:56.137479 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7b8608e1-4e0c-41e0-b9f7-253598eb48ea tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.637354 Aug 12 12:26:56.138130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 549/1119] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:26:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:26:56.151109 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-afa4adae-e87e-489e-a72b-5d72dd0bb20f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:56.151712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-afa4adae-e87e-489e-a72b-5d72dd0bb20f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:56.209045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-afa4adae-e87e-489e-a72b-5d72dd0bb20f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:56.221860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-afa4adae-e87e-489e-a72b-5d72dd0bb20f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1241 microversion: 2.1 time: 0.076616 Aug 12 12:26:56.222512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 571/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:56 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:56.407805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:56.408452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:56.414702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:56.415259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:56.415754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:56.416513 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:56.417058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:56.417577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:56.564355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:56.573623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6bc590d1-aa49-4c1d-971a-a25330410145 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.170578 Aug 12 12:26:56.574249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 550/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:56 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:56.840737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2b913391-a86b-45e1-8ac7-3689fa0b0698 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'create', calling method: .version_select at 0x7f990ef7e4c0>, body: {"keypair": {"name": "tempest-keypair-831904114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKD6xoHDDIye0Q+/U/ZIVYa66lDKyav6dPzPgPvTvlkb+56oiImgrljHqx+BM8ZDkhTJveJyh9nQ3T4ccVmESk8k7sg8fEUw3LxTbiwUIswwTSBHdU4At0OUXGmQsBh05Q=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:56.856496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-2b913391-a86b-45e1-8ac7-3689fa0b0698 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Getting quotas for project f84d5684e1904e569a5551b9e21ce0ff. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:26:56.860295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-2b913391-a86b-45e1-8ac7-3689fa0b0698 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Getting quotas for user 383cbf83186747a5b81a12ed5288c39a and project f84d5684e1904e569a5551b9e21ce0ff. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:26:56.931404 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2b913391-a86b-45e1-8ac7-3689fa0b0698 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.094816 Aug 12 12:26:56.932029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 572/1122] 10.222.0.27 () {62 vars in 1200 bytes} [Fri Aug 12 12:26:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 12 12:26:57.243948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:57.244558 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:57.251127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:57.251648 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:57.252091 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:57.252848 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:57.253302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:57.253727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:57.316396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:57.325502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-373453ed-5a56-4783-b8f7-c1cb793b6ace tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1245 microversion: 2.1 time: 0.084720 Aug 12 12:26:57.325502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 551/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:57 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:57.599667 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:57.600498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:57.606434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:57.607019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:57.607568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:57.608341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:57.608889 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:57.609352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:57.784019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:57.792582 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-564e52e2-b93b-4c09-a2f3-70805bca8c54 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.197583 Aug 12 12:26:57.793197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 573/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:57 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:58.345694 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:58.346293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:58.353312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:58.353814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:58.354237 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:58.354923 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:58.355425 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:58.355845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:58.417920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:58.425169 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-124d5e6b-b1e0-4a01-914f-a62ba82aa52d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1301 microversion: 2.1 time: 0.083832 Aug 12 12:26:58.425733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 552/1125] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:58 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:26:58.814002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:58.814617 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:58.821647 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:58.822401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:58.822836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:58.823533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:58.823986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:58.824411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:58.961761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:58.969100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-efabe19e-402e-480b-9829-b918e4114600 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.159086 Aug 12 12:26:58.970068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 574/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:58 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:59.160744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1119093510", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8429f5b2-c7e8-4466-9db8-df2db15d9f0c"}], "security_groups": [{"name": "tempest-securitygroup--1211999189"}], "key_name": "tempest-keypair-831904114", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:26:59.262168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] validate_networks() for [('8429f5b2-c7e8-4466-9db8-df2db15d9f0c', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:26:59.446239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:59.447475 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:26:59.453379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:59.453859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:59.454288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:59.454971 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:59.455415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:59.455889 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:59.568123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:26:59.576785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a4f6a4f5-4403-4fad-ad2c-f4bb24093c84 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1301 microversion: 2.1 time: 0.134677 Aug 12 12:26:59.577371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 575/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:59 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1301 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:26:59.786530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:26:59.786530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:26:59.786530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:26:59.786530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:26:59.786530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:26:59.805954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:59.806447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:59.806885 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:59.807611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:26:59.808064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:26:59.808489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:26:59.827209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Getting quotas for project f84d5684e1904e569a5551b9e21ce0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:26:59.831345 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Getting quotas for user 383cbf83186747a5b81a12ed5288c39a and project f84d5684e1904e569a5551b9e21ce0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:26:59.844526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:26:59.846960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:26:59.967035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8713088c-f982-48d5-87cb-cf38e7047496 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.810720 Aug 12 12:26:59.967710 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 553/1128] 10.222.0.27 () {62 vars in 1188 bytes} [Fri Aug 12 12:26:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 12:26:59.979511 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8b491aa1-f1d8-4ede-a621-3329cc5ca1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:26:59.980797 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8b491aa1-f1d8-4ede-a621-3329cc5ca1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:00.002652 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:00.011827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:00.013802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:00.014607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:00.015303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:00.016220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:00.016883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:00.017465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:00.109800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8b491aa1-f1d8-4ede-a621-3329cc5ca1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:00.118577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8b491aa1-f1d8-4ede-a621-3329cc5ca1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:00.120447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8b491aa1-f1d8-4ede-a621-3329cc5ca1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:00.122145 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8b491aa1-f1d8-4ede-a621-3329cc5ca1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1281 microversion: 2.20 time: 0.147287 Aug 12 12:27:00.122931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 576/1129] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:26:59 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:00.260435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:00.268740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e4342b10-7656-4960-be40-f51a0f8f4ec5 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.269290 Aug 12 12:27:00.269155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 554/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:26:59 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:00.597924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:00.598625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:00.605284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:00.605781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:00.606239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:00.606939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:00.607393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:00.607844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:00.804168 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:00.813061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d57b5c7f-5200-4c32-8648-9a403acc20e7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.219136 Aug 12 12:27:00.813679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 577/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:00 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:01.145336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:01.145872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:01.152508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:01.153018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:01.153449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:01.154127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:01.154576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:01.155025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:01.265733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:01.274810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:01.276312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:01.277436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b003c7b4-80d2-4895-9180-824943f44edf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1285 microversion: 2.20 time: 0.136189 Aug 12 12:27:01.277991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 555/1132] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:01 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:01.290873 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:01.291621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:01.298209 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:01.298764 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:01.299282 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:01.300034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:01.300539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:01.300985 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:01.456093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:01.464947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-eec16152-0741-437f-a4d5-679c13c634df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.178521 Aug 12 12:27:01.465719 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 578/1133] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:01 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:01.480697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-eccfe7db-3da5-41fc-a34f-f9c0b25c0a08 req-6604e0e1-f1c0-4533-8c62-6e507040846d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ebc13e-bbe5-467e-9a7f-d58a333c5b09", "tag": "3d24aa22-05d1-4afa-a856-ecabf8b6b12f"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:01.490308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-eccfe7db-3da5-41fc-a34f-f9c0b25c0a08 req-6604e0e1-f1c0-4533-8c62-6e507040846d service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:01.490815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-eccfe7db-3da5-41fc-a34f-f9c0b25c0a08 req-6604e0e1-f1c0-4533-8c62-6e507040846d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:01.491243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-eccfe7db-3da5-41fc-a34f-f9c0b25c0a08 req-6604e0e1-f1c0-4533-8c62-6e507040846d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:01.502017 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-eccfe7db-3da5-41fc-a34f-f9c0b25c0a08 req-6604e0e1-f1c0-4533-8c62-6e507040846d service nova] Creating event network-changed:3d24aa22-05d1-4afa-a856-ecabf8b6b12f for instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 on hv-cinder-79797 Aug 12 12:27:01.507514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-eccfe7db-3da5-41fc-a34f-f9c0b25c0a08 req-6604e0e1-f1c0-4533-8c62-6e507040846d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029881 Aug 12 12:27:01.508115 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 556/1134] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:01.833690 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:01.834454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:01.841399 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:01.841968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:01.842479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:01.843269 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:01.843813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:01.844304 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:01.974070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:01.981552 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f724371f-ab12-4c3e-87f5-156a67eff4ad tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.151757 Aug 12 12:27:01.982114 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 579/1135] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:01 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:02.300341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:02.301061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:02.307952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:02.308452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:02.308891 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:02.309589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:02.310036 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:02.310488 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:02.386410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:02.394498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:02.396063 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:02.397408 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fbee466a-0ec1-4dbb-a4c2-9181b2169655 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1333 microversion: 2.20 time: 0.101579 Aug 12 12:27:02.410583 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 557/1136] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:02 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:02.486866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:02.487468 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:02.495307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:02.495780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:02.496210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:02.497104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:02.497555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:02.497974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:02.632282 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:02.639618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8dda8e07-6385-4df7-9164-d441d346cb05 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.156945 Aug 12 12:27:02.640178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 580/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:02 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:03.002638 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:03.003242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:03.010496 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:03.011058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:03.011567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:03.012341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:03.014631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:03.014631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:03.149070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:03.156450 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-932fd981-f9bd-42bd-a8cb-3eb9dcb8096f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.157583 Aug 12 12:27:03.157048 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 558/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:02 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:03.264407 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-7162585a-3ab4-47bc-b9b2-97ceec8cf582 req-1a5eb745-6836-4684-87e0-48c9d2ac51ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246a125c-dd37-4c1c-880b-b7ddf37ebd11", "name": "network-vif-plugged", "status": "completed", "tag": "54968b04-455b-4d52-ab10-345d319d9a7d"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:03.275039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-7162585a-3ab4-47bc-b9b2-97ceec8cf582 req-1a5eb745-6836-4684-87e0-48c9d2ac51ab service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:03.275519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-7162585a-3ab4-47bc-b9b2-97ceec8cf582 req-1a5eb745-6836-4684-87e0-48c9d2ac51ab service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:03.275950 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-7162585a-3ab4-47bc-b9b2-97ceec8cf582 req-1a5eb745-6836-4684-87e0-48c9d2ac51ab service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:03.286860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-7162585a-3ab4-47bc-b9b2-97ceec8cf582 req-1a5eb745-6836-4684-87e0-48c9d2ac51ab service nova] Creating event network-vif-plugged:54968b04-455b-4d52-ab10-345d319d9a7d for instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 on hv-cinder-79797 Aug 12 12:27:03.293032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-7162585a-3ab4-47bc-b9b2-97ceec8cf582 req-1a5eb745-6836-4684-87e0-48c9d2ac51ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032352 Aug 12 12:27:03.293646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 581/1139] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:03.419365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:03.419946 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:03.426532 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:03.427005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:03.427433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:03.428109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:03.429079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:03.429494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:03.492674 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:03.500663 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:03.502217 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:03.503352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a56422f7-88a5-454f-9c8f-1807e4cb34f4 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1351 microversion: 2.20 time: 0.087938 Aug 12 12:27:03.507305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 559/1140] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:03 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:03.661867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:03.662562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:03.668928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:03.669399 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:03.669829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:03.670500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:03.671077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:03.671497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:03.803161 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:03.811556 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-53ae9082-ace7-4046-a150-8921269f87df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.154505 Aug 12 12:27:03.812132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 582/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:03 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:04.176311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:04.176961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:04.183162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:04.183639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:04.184102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:04.184922 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:04.185384 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:04.185802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:04.310968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:04.318286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-df58a2d3-d997-4416-8a93-27ef870065f5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.145852 Aug 12 12:27:04.318848 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 560/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:04 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:04.526976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:04.527492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:04.533442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:04.533914 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:04.534339 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:04.535017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:04.535459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:04.535877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:04.596071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:04.603872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:04.605415 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:04.606516 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-03862c6d-d155-4eb1-894f-fec3a5d202ce tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1351 microversion: 2.20 time: 0.084290 Aug 12 12:27:04.607068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 583/1143] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:04 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:04.832167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:04.832805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:04.840141 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:04.840624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:04.841079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:04.841795 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:04.842245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:04.842662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:04.973794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:04.981228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-42760442-73a6-403a-a1bb-cfc002a0e065 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.152999 Aug 12 12:27:04.981788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 561/1144] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:04 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:05.339296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:05.339921 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:05.346390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:05.346792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:05.347219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:05.347894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:05.348338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:05.348791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:05.492167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:05.503821 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3ec7d2a4-274c-41f8-aea0-aec3d87ed2db tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.167957 Aug 12 12:27:05.519041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 584/1145] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:05 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:05.629597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:05.630208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:05.632213 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:05.637060 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:05.637540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:05.637972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:05.638657 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:05.639111 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:05.639534 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:05.714164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:05.722299 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:05.723802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:05.724929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0272b854-ac94-471f-8a3b-18b9660beb06 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1339 microversion: 2.20 time: 0.099325 Aug 12 12:27:05.726140 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 562/1146] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:05 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:06.001153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:06.002014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:06.008990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:06.009705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:06.010295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:06.011164 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:06.011768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:06.012344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:06.029579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:06.486306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:06.494815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4870d9ce-e51e-4402-ba25-d819c492ffbd tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.497450 Aug 12 12:27:06.495438 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 585/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:05 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:06.525915 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:06.526526 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:06.534328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:06.534809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:06.535248 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:06.536066 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:06.536523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:06.536982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:06.713927 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:06.722223 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fb21537f-fa49-4654-a444-d04dc54b15a6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.201112 Aug 12 12:27:06.722830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 563/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:06 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:06.750443 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:06.751329 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:06.758758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:06.759228 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:06.759671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:06.760372 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:06.760868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:06.764795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:06.900915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:06.908838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:06.910292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:06.911400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b4ba7e82-0662-4460-8c31-ea0a7f59430e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.164928 Aug 12 12:27:06.911941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 586/1149] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:06 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:07.448199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-88938a23-606a-409c-9908-f3f3e5052f2d req-154d48fb-f334-4c16-a0b2-af8a9ceb69c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ebc13e-bbe5-467e-9a7f-d58a333c5b09", "name": "network-vif-plugged", "status": "completed", "tag": "3d24aa22-05d1-4afa-a856-ecabf8b6b12f"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:07.461243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-88938a23-606a-409c-9908-f3f3e5052f2d req-154d48fb-f334-4c16-a0b2-af8a9ceb69c0 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:07.461697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-88938a23-606a-409c-9908-f3f3e5052f2d req-154d48fb-f334-4c16-a0b2-af8a9ceb69c0 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:07.462250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-88938a23-606a-409c-9908-f3f3e5052f2d req-154d48fb-f334-4c16-a0b2-af8a9ceb69c0 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:07.466001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:07.473148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-88938a23-606a-409c-9908-f3f3e5052f2d req-154d48fb-f334-4c16-a0b2-af8a9ceb69c0 service nova] Creating event network-vif-plugged:3d24aa22-05d1-4afa-a856-ecabf8b6b12f for instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 on hv-cinder-79797 Aug 12 12:27:07.479544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-88938a23-606a-409c-9908-f3f3e5052f2d req-154d48fb-f334-4c16-a0b2-af8a9ceb69c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035285 Aug 12 12:27:07.479544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 564/1150] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:07.515539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:07.516149 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:07.525685 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:07.525685 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:07.525685 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:07.525685 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:07.526205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:07.526205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:07.675634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:07.683296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-dbcdf777-6919-4b6a-91c9-b38cd1524c42 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1266 microversion: 2.1 time: 0.171676 Aug 12 12:27:07.683869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 587/1151] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:07 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:07.704164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-7cdd29be-eb3b-4eaf-9bf7-2ac787d2ec39 req-9914a71f-4854-4528-b6ec-5089669a60c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f15496-02a4-4b9a-838c-16a09258073a", "tag": "49a4b862-501e-4f3a-8a03-2ad524857c12"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:07.715480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7cdd29be-eb3b-4eaf-9bf7-2ac787d2ec39 req-9914a71f-4854-4528-b6ec-5089669a60c9 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:07.715953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7cdd29be-eb3b-4eaf-9bf7-2ac787d2ec39 req-9914a71f-4854-4528-b6ec-5089669a60c9 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:07.716381 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7cdd29be-eb3b-4eaf-9bf7-2ac787d2ec39 req-9914a71f-4854-4528-b6ec-5089669a60c9 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:07.728026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-7cdd29be-eb3b-4eaf-9bf7-2ac787d2ec39 req-9914a71f-4854-4528-b6ec-5089669a60c9 service nova] Creating event network-changed:49a4b862-501e-4f3a-8a03-2ad524857c12 for instance d7f15496-02a4-4b9a-838c-16a09258073a on hv-cinder-79797 Aug 12 12:27:07.732517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-7cdd29be-eb3b-4eaf-9bf7-2ac787d2ec39 req-9914a71f-4854-4528-b6ec-5089669a60c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033223 Aug 12 12:27:07.733167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 565/1152] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:27:07.743313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:07.743931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:07.757355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:07.757355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:07.757355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:07.757355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:07.757718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:07.757718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:07.934345 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:07.934988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:07.935680 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:07.942269 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:07.942747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:07.942910 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d56e11f3-5c1d-4759-9eeb-9b85f11cc1f3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.203469 Aug 12 12:27:07.943178 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:07.943684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 588/1153] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:07 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:07.944736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:07.945236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:07.945663 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:08.116310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:08.124494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:08.128551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:08.128551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8023cc97-25bf-4a0e-9d35-6c5f8f800a7a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.196562 Aug 12 12:27:08.128551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 566/1154] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:07 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:27:08.704197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:08.704849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:08.711253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:08.711781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:08.712213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:08.712940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:08.713393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:08.713816 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:08.910673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:08.919713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-74ca75c1-5883-4e5c-8ca9-8606bfe16895 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1453 microversion: 2.1 time: 0.219362 Aug 12 12:27:08.920290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 589/1155] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:08 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1453 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:08.941313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:08.941948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:08.949931 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:08.950418 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:08.950850 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:08.951540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:08.951992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:08.952785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:08.966557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:08.967586 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:08.976402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:08.977417 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:08.978062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:08.979060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:08.979850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:08.980508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:09.223795 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:09.231431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:09.232459 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f7474cd3-4231-495a-9752-b887d856adb4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1453 microversion: 2.1 time: 0.295033 Aug 12 12:27:09.233190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 567/1156] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:08 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1453 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:09.244924 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:09.244924 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:09.245154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ba69761a-6f5a-4019-a0a5-ee1eafefc1d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.278350 Aug 12 12:27:09.245154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 590/1157] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:08 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:09.245341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:09.245774 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:09.246432 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:09.247187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:09.247703 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:09.248254 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:09.379826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:09.387982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:09.389556 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:09.390669 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2e2c4a13-10d1-4844-8251-434efee408aa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.156274 Aug 12 12:27:09.391246 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 568/1158] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:09 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:10.262629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:10.263278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:10.265641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=8 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:10.270405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:10.277058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:10.277058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:10.277058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:10.277058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:10.277460 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:10.414183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:10.414788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:10.416791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=4 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:10.417590 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=16 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:10.422103 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:10.423145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:10.423704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:10.424208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:10.430058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:10.430058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:10.430058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:10.430340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-00df1d49-a921-457d-af82-60d449f5e1f2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1366 microversion: 2.1 time: 0.173025 Aug 12 12:27:10.431328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 591/1159] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:10 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:10.628035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:10.636502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:10.638045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:10.639144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-98521887-49b9-474c-a61d-18cf8cb7b09f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.229230 Aug 12 12:27:10.639712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 569/1160] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:10 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:27:11.451933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:11.452543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:11.461008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:11.461504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:11.461944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:11.462680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:11.463424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:11.463845 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:11.618652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:11.626543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5bd91d1a-79fb-4950-a45c-bc5ee8e03df7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1556 microversion: 2.1 time: 0.178866 Aug 12 12:27:11.627121 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 592/1161] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:11 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:11.648045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:11.648812 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:11.655760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:11.656879 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:11.657530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:11.658576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:11.659415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:11.660175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:11.663924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:11.663924 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:11.670803 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:11.671408 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:11.671802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:11.672526 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:11.673012 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:11.673442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:11.795536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7dc6899e-7f0d-4034-916f-913a0198f6d2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.152118 Aug 12 12:27:11.801168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 570/1162] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 12 12:27:11 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:27:11.809334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-626af1ab-27d3-4826-b4ca-ad1c1b2b5ea8 req-a2e9f1ff-bb26-4d25-bd93-9c26a3a3700c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246a125c-dd37-4c1c-880b-b7ddf37ebd11", "tag": "54968b04-455b-4d52-ab10-345d319d9a7d"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:11.821698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-626af1ab-27d3-4826-b4ca-ad1c1b2b5ea8 req-a2e9f1ff-bb26-4d25-bd93-9c26a3a3700c service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:11.822424 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-626af1ab-27d3-4826-b4ca-ad1c1b2b5ea8 req-a2e9f1ff-bb26-4d25-bd93-9c26a3a3700c service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:11.823107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-626af1ab-27d3-4826-b4ca-ad1c1b2b5ea8 req-a2e9f1ff-bb26-4d25-bd93-9c26a3a3700c service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:11.835562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-626af1ab-27d3-4826-b4ca-ad1c1b2b5ea8 req-a2e9f1ff-bb26-4d25-bd93-9c26a3a3700c service nova] Creating event network-changed:54968b04-455b-4d52-ab10-345d319d9a7d for instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 on hv-cinder-79797 Aug 12 12:27:11.841806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-626af1ab-27d3-4826-b4ca-ad1c1b2b5ea8 req-a2e9f1ff-bb26-4d25-bd93-9c26a3a3700c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038754 Aug 12 12:27:11.842628 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 571/1163] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:11.994840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:12.003644 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:12.005235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:12.006371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1721d111-e468-403f-a78a-2848a5238452 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.348023 Aug 12 12:27:12.007196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 593/1164] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:11 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:13.030113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:13.030821 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:13.037560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:13.038205 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:13.038842 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:13.039732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:13.040176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:13.040634 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:13.174083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:13.182323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:13.183921 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:13.185163 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d1e70314-2060-489c-a80b-22105c210a85 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.159409 Aug 12 12:27:13.185810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 572/1165] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:13 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:13.859689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-a91fceec-3e80-4696-85a5-4f59f498699a req-2b3c2790-3c18-4694-b3f0-8aef7b1c89ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ebc13e-bbe5-467e-9a7f-d58a333c5b09", "tag": "3d24aa22-05d1-4afa-a856-ecabf8b6b12f"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:13.864988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:13.870785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-a91fceec-3e80-4696-85a5-4f59f498699a req-2b3c2790-3c18-4694-b3f0-8aef7b1c89ba service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:13.871343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-a91fceec-3e80-4696-85a5-4f59f498699a req-2b3c2790-3c18-4694-b3f0-8aef7b1c89ba service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:13.871770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-a91fceec-3e80-4696-85a5-4f59f498699a req-2b3c2790-3c18-4694-b3f0-8aef7b1c89ba service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:13.883252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-a91fceec-3e80-4696-85a5-4f59f498699a req-2b3c2790-3c18-4694-b3f0-8aef7b1c89ba service nova] Creating event network-changed:3d24aa22-05d1-4afa-a856-ecabf8b6b12f for instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 on hv-cinder-79797 Aug 12 12:27:13.888009 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-a91fceec-3e80-4696-85a5-4f59f498699a req-2b3c2790-3c18-4694-b3f0-8aef7b1c89ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032209 Aug 12 12:27:13.888577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 594/1166] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:14.209480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:14.210095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:14.216779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:14.217272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:14.217711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:14.218408 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:14.218866 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:14.219290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:14.511329 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:14.519405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:14.521021 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:14.522132 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-27fc5622-bdbe-4e08-809a-15e824be1e71 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.317230 Aug 12 12:27:14.522757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 573/1167] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:14 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:15.545293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:15.546642 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:15.553251 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:15.553768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:15.554226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:15.555112 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:15.555558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:15.555974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:15.684592 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:15.692599 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:15.698541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:15.698541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1f1c9cf5-270a-4ba0-87be-b8182db33e3d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.154736 Aug 12 12:27:15.698541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 595/1168] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:15 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:16.719149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:16.719753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:16.726894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:16.727365 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:16.727796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:16.728469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:16.728939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:16.729357 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:16.861161 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:16.869914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:16.871447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:16.872573 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-28c18842-9535-47e6-9f77-00e92cdda453 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.157319 Aug 12 12:27:16.873156 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 574/1169] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:16 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:17.195872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:17.196357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:17.202595 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:17.203079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:17.203512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:17.204195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:17.204670 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:17.205093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:17.285838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lazy-loading 'services' on Instance uuid 73f381d7-b452-42ba-a0f0-1b4b74c3e07a {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:27:17.553539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2ecec426-11f5-4c3b-a16b-4099aa68af78 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/os-volume_attachments/f467aa86-93f1-4809-942e-1bacc90038f3" status: 202 len: 0 microversion: 2.1 time: 0.474798 Aug 12 12:27:17.554870 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 596/1170] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:27:17 2022] DELETE /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/os-volume_attachments/f467aa86-93f1-4809-942e-1bacc90038f3 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:27:17.683739 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-7f2e8f3d-62d6-4647-a3d2-04bda45a56a9 req-cd026df5-5813-40fd-a985-f886fc408d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f15496-02a4-4b9a-838c-16a09258073a", "name": "network-vif-plugged", "status": "completed", "tag": "49a4b862-501e-4f3a-8a03-2ad524857c12"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:17.693711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7f2e8f3d-62d6-4647-a3d2-04bda45a56a9 req-cd026df5-5813-40fd-a985-f886fc408d48 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:17.694193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7f2e8f3d-62d6-4647-a3d2-04bda45a56a9 req-cd026df5-5813-40fd-a985-f886fc408d48 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:17.694967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7f2e8f3d-62d6-4647-a3d2-04bda45a56a9 req-cd026df5-5813-40fd-a985-f886fc408d48 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:17.707176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-7f2e8f3d-62d6-4647-a3d2-04bda45a56a9 req-cd026df5-5813-40fd-a985-f886fc408d48 service nova] Creating event network-vif-plugged:49a4b862-501e-4f3a-8a03-2ad524857c12 for instance d7f15496-02a4-4b9a-838c-16a09258073a on hv-cinder-79797 Aug 12 12:27:17.713576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-7f2e8f3d-62d6-4647-a3d2-04bda45a56a9 req-cd026df5-5813-40fd-a985-f886fc408d48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Aug 12 12:27:17.714412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 575/1171] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:17.894595 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:17.895279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:17.902186 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:17.902657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:17.903088 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:17.903767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:17.904207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:17.904622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:18.031032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:18.039633 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:18.041159 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:18.042252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ac5b998c-81e2-4a44-8e82-af48fd3c0288 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.151973 Aug 12 12:27:18.042893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 597/1172] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:17 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:19.066640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:19.067256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:19.074138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:19.074625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:19.075064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:19.075761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:19.076218 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:19.076775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:19.207113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:19.215201 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:19.216724 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:19.219704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bc8c75cb-13fa-414e-bd4f-bfb51e66bb41 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.156144 Aug 12 12:27:19.219704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 576/1173] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:19 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:19.727544 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bce74eb9-168f-4a5e-b4a6-d483d72e7cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:19.734040 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce74eb9-168f-4a5e-b4a6-d483d72e7cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:19.734521 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce74eb9-168f-4a5e-b4a6-d483d72e7cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:19.734958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bce74eb9-168f-4a5e-b4a6-d483d72e7cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:19.797211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bce74eb9-168f-4a5e-b4a6-d483d72e7cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Going to try to stop instance {{(pid=121154) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 12:27:20.002994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bce74eb9-168f-4a5e-b4a6-d483d72e7cab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/action" status: 202 len: 0 microversion: 2.1 time: 0.279651 Aug 12 12:27:20.003497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 598/1174] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:27:19 2022] POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:27:20.011708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:20.012315 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:20.018582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:20.019101 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:20.019535 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:20.020212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:20.021153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:20.021580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:20.153971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:20.161428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d0bcc389-df02-440e-845e-7779595d3bcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.153547 Aug 12 12:27:20.161996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 577/1175] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:20 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:20.241126 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:20.241959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:20.248266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:20.248900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:20.249247 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:20.249955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:20.250412 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:20.250842 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:20.387473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:20.395670 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:20.398432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:20.399245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9e7eedf7-9de3-4fcb-b588-24da5695a733 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1407 microversion: 2.20 time: 0.162378 Aug 12 12:27:20.399874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 599/1176] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:20 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:21.183380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:21.184847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:21.192397 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:21.192916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:21.194023 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:21.194888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:21.195359 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:21.195792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:21.325969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:21.333405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f5f65581-82ba-450a-acf0-839c7c705fda tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.154494 Aug 12 12:27:21.333969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 578/1177] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:21 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:21.421804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:21.422411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:21.428966 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:21.429549 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:21.429986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:21.430682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:21.431134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:21.431558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:21.561541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:21.569505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:21.571342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:21.572491 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b98a57f2-d27e-4bc8-a23a-4c774a2784ca tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1600 microversion: 2.20 time: 0.154639 Aug 12 12:27:21.573093 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 600/1178] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:27:21 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:27:21.596195 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:21.596705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:21.602708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:21.603194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:21.603627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:21.604313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:21.604804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:21.605229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:21.681166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-51df3515-51da-49b9-badf-fb960d5b4eb5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088735 Aug 12 12:27:21.681764 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 579/1179] 10.222.0.27 () {60 vars in 1316 bytes} [Fri Aug 12 12:27:21 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:27:22.316585 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:27:22.316801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Fri Aug 12 12:27:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:27:22.356545 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:22.357098 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:22.363054 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:22.363538 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:22.363972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:22.364665 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:22.365124 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:22.365550 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:22.370203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:22.577139 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:22.584670 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-631de5e4-17ec-4e10-ab95-7fcf7e283fef tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.233959 Aug 12 12:27:22.585937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 601/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:22 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:22.719729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-c8172b5f-cd0d-4f59-9cfd-bb6a3fd61074 req-a198ed21-bd9f-4f6d-a1dd-0d3f539126db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f15496-02a4-4b9a-838c-16a09258073a", "tag": "49a4b862-501e-4f3a-8a03-2ad524857c12"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:22.729685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c8172b5f-cd0d-4f59-9cfd-bb6a3fd61074 req-a198ed21-bd9f-4f6d-a1dd-0d3f539126db service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:22.730162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c8172b5f-cd0d-4f59-9cfd-bb6a3fd61074 req-a198ed21-bd9f-4f6d-a1dd-0d3f539126db service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:22.730592 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c8172b5f-cd0d-4f59-9cfd-bb6a3fd61074 req-a198ed21-bd9f-4f6d-a1dd-0d3f539126db service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:22.742566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-c8172b5f-cd0d-4f59-9cfd-bb6a3fd61074 req-a198ed21-bd9f-4f6d-a1dd-0d3f539126db service nova] Creating event network-changed:49a4b862-501e-4f3a-8a03-2ad524857c12 for instance d7f15496-02a4-4b9a-838c-16a09258073a on hv-cinder-79797 Aug 12 12:27:22.747564 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-c8172b5f-cd0d-4f59-9cfd-bb6a3fd61074 req-a198ed21-bd9f-4f6d-a1dd-0d3f539126db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032037 Aug 12 12:27:22.748180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 580/1181] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:23.606666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:23.607274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:23.613802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:23.614286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:23.614722 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:23.615411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:23.615856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:23.616332 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:23.748712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:23.756614 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-dd019032-8334-464a-b33a-189e512b469f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.153737 Aug 12 12:27:23.757249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 602/1182] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:23 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:24.779056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:24.779743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:24.786089 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:24.786574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:24.787011 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:24.787725 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:24.788177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:24.788602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:24.921302 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:24.928679 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bd0d8fcd-d078-4557-adc8-16be8d42ad18 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.154395 Aug 12 12:27:24.929386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 581/1183] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:24 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:25.951566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:25.952195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:25.958606 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:25.959075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:25.959505 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:25.960177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:25.960617 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:25.961053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:26.089016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:26.096323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2b3fee88-7666-4313-87cc-5cc019ce2b3f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.149525 Aug 12 12:27:26.096913 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 603/1184] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:25 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:27.116734 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:27.117310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:27.124168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:27.124660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:27.125100 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:27.125775 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:27.126218 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:27.126643 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:27.254937 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:27.262454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dd004701-63cc-4847-9a23-c6a671ed3953 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.149637 Aug 12 12:27:27.263022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 582/1185] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:27 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:28.283131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:28.283726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:28.290373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:28.290853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:28.291976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:28.292433 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:28.292879 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:28.431973 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:28.439702 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fb5ed688-ce62-4a2a-a1a8-99d45874647b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.160504 Aug 12 12:27:28.440348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 604/1186] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:28 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:29.465101 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:29.465714 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:29.471753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:29.472233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:29.472697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:29.473379 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:29.473831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:29.474253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:29.602794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:29.610193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-841de492-bd4a-45a4-8ad3-067297b055a5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.149218 Aug 12 12:27:29.610754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 583/1187] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:29 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:30.631298 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:30.631903 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:30.639278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:30.639759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:30.640197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:30.640913 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:30.641364 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:30.641783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:30.768655 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:30.776211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c5af99bf-6d1f-4a46-b277-9abc8ffee131 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.148794 Aug 12 12:27:30.776797 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 605/1188] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:30 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:31.798086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:31.798600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:31.806029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:31.806610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:31.807051 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:31.807764 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:31.808226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:31.808664 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:31.938249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:31.941749 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:31.946073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c060f4f5-37cd-42c1-895a-167facdae15d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.151967 Aug 12 12:27:31.946765 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 584/1189] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:31 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:32.967343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:32.967946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:32.974462 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:32.974970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:32.975405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:32.976086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:32.976539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:32.976989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:33.107875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:33.115289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-01d04a00-24cd-4210-abc4-f14e5f0096dd tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.151846 Aug 12 12:27:33.115866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 606/1190] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:32 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:34.136452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:34.137042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:34.143555 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:34.144038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:34.144478 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:34.145204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:34.145662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:34.146090 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:34.273695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:34.281726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6f7fc85e-e9c4-4a05-bc2e-897c696ea6e4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.149663 Aug 12 12:27:34.282290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 585/1191] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:34 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:35.302549 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:35.303152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:35.310416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:35.310892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:35.311323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:35.311997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:35.312440 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:35.312887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:35.448048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:35.455776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b379be15-9b08-4ad9-8f7a-cb07eff0994c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.157330 Aug 12 12:27:35.460342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 607/1192] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:35 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:36.476894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:36.478201 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:36.484443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:36.484984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:36.485404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:36.486085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:36.486539 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:36.486958 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:36.614063 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:36.621728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5a52d6e9-228e-4b6e-bffc-8e1463dbb1f5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.148813 Aug 12 12:27:36.622292 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 586/1193] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:36 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:37.642885 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:37.643411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:37.649918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:37.650399 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:37.650839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:37.651523 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:37.651975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:37.652402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:37.778663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:37.786019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-dcdbf42f-539a-4724-a40d-78f84c6b97b7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.147165 Aug 12 12:27:37.786623 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 608/1194] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:37 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:38.807394 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:38.807935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:38.813054 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=50 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:38.815837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:38.816309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:38.816767 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:38.817444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:38.817887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:38.818304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:38.949462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:38.957006 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b85a35bc-cb71-42d8-901d-7acd4b892d70 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.153471 Aug 12 12:27:38.957565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 587/1195] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:38 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:39.977814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:39.978397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:39.984954 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:39.985430 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:39.985867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:39.986549 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:39.987006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:39.987424 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:40.114294 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:40.122433 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-db7e273d-f680-4514-bf10-e5a2d47b140f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1676 microversion: 2.1 time: 0.148472 Aug 12 12:27:40.123029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 609/1196] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:39 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:41.144712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:41.145234 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:41.152174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:41.152670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:41.153105 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:41.153788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:41.154295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:41.154724 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:41.284806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:41.292791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1939a148-c385-49b9-8160-d785a730054f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1653 microversion: 2.1 time: 0.151994 Aug 12 12:27:41.293354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 588/1197] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:41 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:41.312519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d6aee5e8-7d1b-4d1d-9983-7ad0a19ad5b2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:41.319070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6aee5e8-7d1b-4d1d-9983-7ad0a19ad5b2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:41.319553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6aee5e8-7d1b-4d1d-9983-7ad0a19ad5b2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:41.319991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-d6aee5e8-7d1b-4d1d-9983-7ad0a19ad5b2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:41.342945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-d6aee5e8-7d1b-4d1d-9983-7ad0a19ad5b2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Going to try to start instance {{(pid=121154) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 12:27:41.523691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d6aee5e8-7d1b-4d1d-9983-7ad0a19ad5b2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/action" status: 202 len: 0 microversion: 2.1 time: 0.214814 Aug 12 12:27:41.525208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 610/1198] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:27:41 2022] POST /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:27:41.533540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:41.534231 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:41.540507 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:41.541121 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:41.541578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:41.542266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:41.542714 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:41.543135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:41.673582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:41.681756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8a1950b5-86fd-4ec2-a1a0-b484ae37e844 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1662 microversion: 2.1 time: 0.152116 Aug 12 12:27:41.682326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 589/1199] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:41 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:42.704627 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:42.705339 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:42.711392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:42.712554 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:42.713088 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:42.713763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:42.714212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:42.714637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:42.846651 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:42.856065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9084efd4-60a8-4697-b730-581a0a5ba0ab tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1662 microversion: 2.1 time: 0.156415 Aug 12 12:27:42.860809 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 611/1200] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:42 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:43.877833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:43.878435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:43.884935 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:43.886220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:43.886655 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:43.887331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:43.887807 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:43.888227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:44.016544 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:44.023906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f1bfe7ba-8b56-4d20-ac6f-31e71bc447e9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1666 microversion: 2.1 time: 0.149949 Aug 12 12:27:44.024498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 590/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:43 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:51.253441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:51.253976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:51.256435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=36 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:51.261206 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:51.261681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:51.262136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:51.262815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:51.263270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:51.264321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:51.342657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lazy-loading 'services' on Instance uuid 836dc0f4-7d00-4730-9828-909cded7ec39 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:27:51.561077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ec9f36f9-49bc-43c5-967b-8dc7730a1eda tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments/203ead5c-8cf3-4a72-b57d-6af7be21e7d0" status: 202 len: 0 microversion: 2.1 time: 0.310631 Aug 12 12:27:51.561703 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 612/1202] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:27:51 2022] DELETE /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments/203ead5c-8cf3-4a72-b57d-6af7be21e7d0 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:27:51.570143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:51.572314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:51.579961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:51.581815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:51.581815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:51.581815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:51.582185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:51.582472 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:51.613945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9407401d-0e5e-4cbe-892e-c76a4b8c6e43 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047801 Aug 12 12:27:51.614515 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 591/1203] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:51 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:51.931683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1387200846"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:51.932328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:51.938799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:51.939277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:51.939708 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:51.940385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:51.940866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:51.941289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:52.066219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.network.security_group_api [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Removing security group af45a014-a1ee-4e2d-aae7-84ef383324fe from port 17af596b-a31a-4ac9-a3a4-e4bae611ce04 Aug 12 12:27:52.432689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-49195e11-9e0e-4abd-aaee-d5f57867ffb4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "POST /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/action" status: 202 len: 0 microversion: 2.1 time: 0.604614 Aug 12 12:27:52.433784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 613/1204] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:27:51 2022] POST /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:27:52.441538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-2ab3ec03-999b-47ed-8a66-f90c7d2f791b req-c5fcf984-3911-4470-bc6e-755f5347734f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2cbb43-b41e-4e49-9529-e0f7db8b3079", "tag": "17af596b-a31a-4ac9-a3a4-e4bae611ce04"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:52.452968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2ab3ec03-999b-47ed-8a66-f90c7d2f791b req-c5fcf984-3911-4470-bc6e-755f5347734f service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:52.458471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2ab3ec03-999b-47ed-8a66-f90c7d2f791b req-c5fcf984-3911-4470-bc6e-755f5347734f service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:52.458471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2ab3ec03-999b-47ed-8a66-f90c7d2f791b req-c5fcf984-3911-4470-bc6e-755f5347734f service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:52.469154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-2ab3ec03-999b-47ed-8a66-f90c7d2f791b req-c5fcf984-3911-4470-bc6e-755f5347734f service nova] Creating event network-changed:17af596b-a31a-4ac9-a3a4-e4bae611ce04 for instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 on hv-cinder-79797 Aug 12 12:27:52.476135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-2ab3ec03-999b-47ed-8a66-f90c7d2f791b req-c5fcf984-3911-4470-bc6e-755f5347734f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037803 Aug 12 12:27:52.477143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 592/1205] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:52.626767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:52.629291 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:52.635593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:52.636133 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:52.636569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:52.637277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:52.637722 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:52.638140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:52.642716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:27:52.668774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0c7e5829-7374-46a0-a750-971c24876365 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046177 Aug 12 12:27:52.669360 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 614/1206] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:52 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:53.682000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:53.684607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:53.692592 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:53.693128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:53.693572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:53.694310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:53.694768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:53.695196 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:53.727496 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-42fb5c6d-2241-4deb-b01c-9c29c48ea82d tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049911 Aug 12 12:27:53.728072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 593/1207] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:53 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:27:53.818514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:53.819064 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:53.827338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:53.830611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:53.830611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:53.830611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:53.830611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:53.830985 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:53.855420 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Going to try to terminate instance {{(pid=121154) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:27:53.913978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:53.914551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:53.921439 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:53.922039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:53.922568 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:53.923324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:53.923784 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:53.924212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:54.007771 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lazy-loading 'services' on Instance uuid 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:27:54.098558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b22b176e-2ba2-4857-8245-2c85d6bc5da1 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 204 len: 0 microversion: 2.1 time: 0.283806 Aug 12 12:27:54.099149 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 615/1208] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:27:53 2022] DELETE /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:27:54.104374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-b1a2d3e9-174f-44a5-9a47-e3c44bc867b8 req-48617af9-bdaf-4529-8a64-6643bb5c57e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2cbb43-b41e-4e49-9529-e0f7db8b3079", "tag": "17af596b-a31a-4ac9-a3a4-e4bae611ce04"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:54.114079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b1a2d3e9-174f-44a5-9a47-e3c44bc867b8 req-48617af9-bdaf-4529-8a64-6643bb5c57e7 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:54.114548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b1a2d3e9-174f-44a5-9a47-e3c44bc867b8 req-48617af9-bdaf-4529-8a64-6643bb5c57e7 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:54.114971 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-b1a2d3e9-174f-44a5-9a47-e3c44bc867b8 req-48617af9-bdaf-4529-8a64-6643bb5c57e7 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:54.129112 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-b1a2d3e9-174f-44a5-9a47-e3c44bc867b8 req-48617af9-bdaf-4529-8a64-6643bb5c57e7 service nova] Creating event network-changed:17af596b-a31a-4ac9-a3a4-e4bae611ce04 for instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 on hv-cinder-79797 Aug 12 12:27:54.134502 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-b1a2d3e9-174f-44a5-9a47-e3c44bc867b8 req-48617af9-bdaf-4529-8a64-6643bb5c57e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033906 Aug 12 12:27:54.137100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 616/1209] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:54.140313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:54.141069 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:54.147576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:54.148052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:54.148486 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:54.149217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:54.149664 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:54.150085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:54.218386 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3cf97ecb-ab46-4307-bfca-916d9b026ea0 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments/5e1f87d1-6d47-4b8d-8333-ed32d5853c21" status: 202 len: 0 microversion: 2.1 time: 0.308485 Aug 12 12:27:54.218978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 594/1210] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:27:53 2022] DELETE /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments/5e1f87d1-6d47-4b8d-8333-ed32d5853c21 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 12:27:54.228163 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:54.230797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:54.241361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:54.241857 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:54.242304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:54.243039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:54.243704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:54.244129 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:54.276952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b3f2c609-4912-4ddd-8cc4-1c046bfa9643 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053257 Aug 12 12:27:54.277757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 595/1211] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:54 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:54.293388 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:54.301396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-30881731-0f2d-467f-b928-cb0d69e4421e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1690 microversion: 2.1 time: 0.165215 Aug 12 12:27:54.301969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 617/1212] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:54 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:55.290331 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:55.292372 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:55.299741 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:55.300220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:55.300670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:55.301349 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:55.301791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:55.302209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:55.322307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:55.322913 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:55.329636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:55.330116 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:55.330551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:55.331033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-325a954d-ba9b-4bd6-a31c-4a7524fdba09 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Aug 12 12:27:55.331243 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:55.331593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 596/1213] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:55 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:55.331730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:55.332106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:55.463594 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:55.471970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3a4bfe1f-88f3-4b88-98e7-4d2adcdd7925 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1690 microversion: 2.1 time: 0.153449 Aug 12 12:27:55.472547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 618/1214] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:55 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:27:56.343335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:56.345475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:56.351834 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:56.352305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:56.352764 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:56.353474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:56.353919 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:56.354335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:56.384553 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ae8eeb32-5e70-4397-8947-22ae8ae833d3 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Aug 12 12:27:56.385210 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 597/1215] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:56 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:56.492911 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:56.494600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:56.500154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:56.500652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:56.501102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:56.501814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:56.502267 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:56.502691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:56.628573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:56.636328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a1538c6d-f7a9-4619-aec5-629b1b0b0240 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1690 microversion: 2.1 time: 0.147369 Aug 12 12:27:56.636919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 619/1216] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:56 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:57.396271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:57.398704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:57.405074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:57.405550 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:57.405979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:57.406654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:57.407099 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:57.407515 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:57.437660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ee12f6f7-794e-4e22-8572-05bf8a0f9c18 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Aug 12 12:27:57.438231 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 598/1217] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:57 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:57.657238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:57.657845 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:57.664148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:57.664626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:57.665086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:57.665769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:57.666213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:57.666659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:57.791346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:57.799323 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c76bb04a-f1d8-4522-b34f-30a600fc8f1a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1690 microversion: 2.1 time: 0.146010 Aug 12 12:27:57.799890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 620/1218] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:57 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:58.450165 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:58.453097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:58.459739 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:58.460221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:58.460672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:58.461405 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:58.461849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:58.462298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:58.491754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2bf7f66d-0cb0-4e43-b7e2-b0d339bee99e tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Aug 12 12:27:58.497236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 599/1219] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:58 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:58.821859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:58.822599 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:58.830189 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:58.830765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:58.831279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:58.831989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:58.832468 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:58.832919 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:58.903914 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:27:58.912497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c3fb8d9c-7f5c-4748-a6d1-86e115828596 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1622 microversion: 2.1 time: 0.095582 Aug 12 12:27:58.913113 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 621/1220] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:58 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:27:59.165960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-32157eeb-c1ff-4123-9a50-309014789884 req-b28a6252-74a4-40a5-9522-59af74265201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836dc0f4-7d00-4730-9828-909cded7ec39", "name": "network-vif-deleted", "tag": "30720ab8-0d22-48fe-b3f3-2941ca200322"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:27:59.175895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-32157eeb-c1ff-4123-9a50-309014789884 req-b28a6252-74a4-40a5-9522-59af74265201 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:59.176465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-32157eeb-c1ff-4123-9a50-309014789884 req-b28a6252-74a4-40a5-9522-59af74265201 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:59.176985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-32157eeb-c1ff-4123-9a50-309014789884 req-b28a6252-74a4-40a5-9522-59af74265201 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:59.189162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-32157eeb-c1ff-4123-9a50-309014789884 req-b28a6252-74a4-40a5-9522-59af74265201 service nova] Creating event network-vif-deleted:30720ab8-0d22-48fe-b3f3-2941ca200322 for instance 836dc0f4-7d00-4730-9828-909cded7ec39 on hv-cinder-79797 Aug 12 12:27:59.194945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-32157eeb-c1ff-4123-9a50-309014789884 req-b28a6252-74a4-40a5-9522-59af74265201 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Aug 12 12:27:59.195564 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 600/1221] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:27:59.504327 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:59.509725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:59.517084 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:59.517566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:59.517995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:59.518718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:59.519167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:59.519590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:59.549589 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-47245f6f-a542-4fa9-bc0a-caf8b5ae15de tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049308 Aug 12 12:27:59.550174 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 622/1222] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:27:59 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:27:59.562041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:59.562618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:59.568815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:59.569301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:59.569734 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:59.570480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:59.570952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:59.571462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:59.652045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] HTTP exception thrown: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 is not attached to volume 5e1f87d1-6d47-4b8d-8333-ed32d5853c21 Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Request method failure captured: Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: DELETE /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments/5e1f87d1-6d47-4b8d-8333-ed32d5853c21 HTTP/1.1 Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kX_oDmVMLouKzyJF3JxehlCJ2lw4z23c7LOH2uvlwV-a4EV7d03pWkTbWaadoRK5Ngp0nS0Lc6gN8ZN2M1azmAWQNAmajuwHK8v8P7RkwEPKaiCk-yDI7KyX9bjwMmyyN0sOh230CFSZe68nT7-vo-ekFSP_C9ocwjAr7iK7wPZ_pI Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 478411e9884545398aa7fbec4279a57b Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestMinimumBasicScenario-419669766 Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:27:59.662623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/478411e9884545398aa7fbec4279a57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/478411e9884545398aa7fbec4279a57b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_478411e9884545398aa7fbec4279a57b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/478411e9884545398aa7fbec4279a57b"}]}] Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestMinimumBasicScenario-419669766 Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 478411e9884545398aa7fbec4279a57b Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestMinimumBasicScenario-419669766 Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-TestMinimumBasicScenario-419669766-project Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: fbd28b2571a540e7bdd9c15684dee82d Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestMinimumBasicScenario-419669766-project Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:27:59.664183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 is not attached to volume 5e1f87d1-6d47-4b8d-8333-ed32d5853c21 Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'server_id': '8c2cbb43-b41e-4e49-9529-e0f7db8b3079', 'id': '5e1f87d1-6d47-4b8d-8333-ed32d5853c21'} Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5e1f87d1-6d47-4b8d-8333-ed32d5853c21. Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:27:59.664971 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 is not attached to volume 5e1f87d1-6d47-4b8d-8333-ed32d5853c21 Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 is not attached to volume 5e1f87d1-6d47-4b8d-8333-ed32d5853c21 Aug 12 12:27:59.666304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:27:59.668277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Returning 404 to user: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 is not attached to volume 5e1f87d1-6d47-4b8d-8333-ed32d5853c21 {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:27:59.669578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-68af0333-aa9a-4fce-be56-d0a6f05ccc93 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments/5e1f87d1-6d47-4b8d-8333-ed32d5853c21" status: 404 len: 154 microversion: 2.1 time: 0.112741 Aug 12 12:27:59.670333 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 601/1223] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:27:59 2022] DELETE /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079/os-volume_attachments/5e1f87d1-6d47-4b8d-8333-ed32d5853c21 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:27:59.934227 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:27:59.935038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:27:59.943365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:59.943851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:59.944332 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:59.945382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:59.947318 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:59.947318 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:59.979168 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:27:59.979640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:27:59.980076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:27:59.980520 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lazy-loading 'fault' on Instance uuid 836dc0f4-7d00-4730-9828-909cded7ec39 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:28:00.023854 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:00.035322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-107f9172-50a9-4dab-9c40-1cbc0ac997fb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 200 len: 1336 microversion: 2.1 time: 0.105142 Aug 12 12:28:00.036224 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 623/1224] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:27:59 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:00.928730 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:00.929224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:00.935646 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:00.936137 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:00.936584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:00.937311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:00.937753 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:00.938172 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:00.942116 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:00.965469 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:28:01.058797 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:01.059431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 836dc0f4-7d00-4730-9828-909cded7ec39] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:01.066592 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:01.067070 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:01.067501 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:01.068184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:01.068632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:01.069072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:01.083123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] HTTP exception thrown: Instance 836dc0f4-7d00-4730-9828-909cded7ec39 could not be found. Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Request method failure captured: Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 HTTP/1.1 Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU1XxsYk5VN_T93GFCyU7RYD5hJ0BUvCvlf_XfH6CNe7so5BnwxxiAMNAPR3AFdodLdusZpG2dRuzFwRh-WoYlJ9uzjtmndJ9XnlnxpvjQSOcEwevrL5RQryb0o3Z3JjmOG4-zKB_4aZsdhzluBi1_8emtWcCSYZ8JlpKE6IFVAs9c Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:28:01.084836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e8def85acdd4e308bb51b4063c2ab4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}] Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 099b87a6c6b8409ab188c0b71ded7f55 Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 836dc0f4-7d00-4730-9828-909cded7ec39 could not be found. Aug 12 12:28:01.086573 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '836dc0f4-7d00-4730-9828-909cded7ec39'} Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836dc0f4-7d00-4730-9828-909cded7ec39 could not be found. Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:28:01.087503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836dc0f4-7d00-4730-9828-909cded7ec39 could not be found. Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836dc0f4-7d00-4730-9828-909cded7ec39 could not be found. Aug 12 12:28:01.089050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:01.090454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Returning 404 to user: Instance 836dc0f4-7d00-4730-9828-909cded7ec39 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:28:01.090454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2615024f-491b-4b5a-8fed-1f6748d4defb tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39" status: 404 len: 111 microversion: 2.1 time: 0.031528 Aug 12 12:28:01.090454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 624/1225] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:01 2022] GET /compute/v2.1/servers/836dc0f4-7d00-4730-9828-909cded7ec39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:28:01.094520 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5fa609f8-839e-4149-8cdf-b08b2133f13e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '.version_select at 0x7f990ee0f310>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:01.191297 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5fa609f8-839e-4149-8cdf-b08b2133f13e tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503459845" status: 202 len: 0 microversion: 2.1 time: 0.100176 Aug 12 12:28:01.191817 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 625/1226] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 12 12:28:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503459845 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:28:01.213182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8e240dd9-bc3c-4703-9a90-c9a534a8e385 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 204 len: 0 microversion: 2.1 time: 0.287982 Aug 12 12:28:01.213961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 602/1227] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:28:00 2022] DELETE /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:28:01.222437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:01.223108 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:01.229847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:01.230325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:01.230759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:01.231530 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:01.231983 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:01.232726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:01.406291 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:01.413898 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7d60bf28-2adb-4227-98c2-f816cea894f8 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1555 microversion: 2.1 time: 0.195500 Aug 12 12:28:01.414492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 626/1228] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:01 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:28:02.437600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:02.438383 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:02.445651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:02.446183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:02.446699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:02.447580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:02.448083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:02.448514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:02.581948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:02.589638 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a38faf4d-5071-4de4-8082-e68d49fc7a33 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1555 microversion: 2.1 time: 0.157866 Aug 12 12:28:02.590197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 603/1229] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:02 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:02.702269 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:02.702797 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:02.709086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:02.709559 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:02.710020 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:02.710692 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:02.711138 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:02.711555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:02.734972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lazy-loading 'flavor' on Instance uuid c5591717-7940-402d-a1b0-737ee67b0743 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:28:02.993823 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a17b1ffc-83ae-471c-a0f9-9569c4e00212 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "POST /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743/action" status: 202 len: 0 microversion: 2.1 time: 0.295521 Aug 12 12:28:02.994834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 627/1230] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:28:02 2022] POST /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:28:03.003366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:03.004184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:03.010860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:03.011438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:03.011982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:03.012793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:03.013309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:03.014247 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:03.180289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:03.187948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-166c4f05-75d3-4d72-8296-445c97b8e820 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.188721 Aug 12 12:28:03.188567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 604/1231] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:02 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:03.613632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:03.614242 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:03.620223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:03.620725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:03.621160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:03.621837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:03.622281 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:03.622695 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:03.950391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:03.958867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-934b51fd-70a6-4cf4-9056-64c4abc1c2e4 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1555 microversion: 2.1 time: 0.349450 Aug 12 12:28:03.959626 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 628/1232] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:03 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1555 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:04.210881 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:04.211449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:04.217990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.218462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.219014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:04.219699 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.220145 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.220564 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:04.381024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:04.381519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:04.390404 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.395525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.395525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:04.395525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.395525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.396035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:04.397069 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:04.418002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Going to try to terminate instance {{(pid=121154) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:28:04.527092 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:04.535390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a6d9a5f4-2f61-4fd7-99cb-761187f3031b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.328601 Aug 12 12:28:04.535959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 605/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:04 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:04.733895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b334d5fd-d45d-41b0-9a1d-5aeac165f5a8 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 204 len: 0 microversion: 2.1 time: 0.356350 Aug 12 12:28:04.734512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 629/1234] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:28:04 2022] DELETE /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 12:28:04.742631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:04.743283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:04.750148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.755476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.755476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:04.755476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.755476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.755892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:04.952553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-70acfbca-2e8e-4a50-8ecb-68a3ffbdc6ab req-c89760f0-067a-4a1a-bf2a-c6a41f147791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2cbb43-b41e-4e49-9529-e0f7db8b3079", "name": "network-vif-deleted", "tag": "17af596b-a31a-4ac9-a3a4-e4bae611ce04"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:04.961942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-70acfbca-2e8e-4a50-8ecb-68a3ffbdc6ab req-c89760f0-067a-4a1a-bf2a-c6a41f147791 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.962420 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-70acfbca-2e8e-4a50-8ecb-68a3ffbdc6ab req-c89760f0-067a-4a1a-bf2a-c6a41f147791 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.962846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-70acfbca-2e8e-4a50-8ecb-68a3ffbdc6ab req-c89760f0-067a-4a1a-bf2a-c6a41f147791 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:04.974203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-70acfbca-2e8e-4a50-8ecb-68a3ffbdc6ab req-c89760f0-067a-4a1a-bf2a-c6a41f147791 service nova] Creating event network-vif-deleted:17af596b-a31a-4ac9-a3a4-e4bae611ce04 for instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 on hv-cinder-79797 Aug 12 12:28:04.979077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-70acfbca-2e8e-4a50-8ecb-68a3ffbdc6ab req-c89760f0-067a-4a1a-bf2a-c6a41f147791 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031859 Aug 12 12:28:04.979679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 630/1235] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:28:04.984738 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:04.985427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:04.991379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.991848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.992278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:04.992986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:04.993436 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:04.993862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:05.017936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:05.026434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5aebe123-df5a-4e1c-b14a-77c5520a1e2a tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1507 microversion: 2.1 time: 0.287675 Aug 12 12:28:05.027008 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 606/1236] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:04 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:28:05.062735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:05.070259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e53967e6-dfbc-43b8-a751-55d214e73cbe tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1513 microversion: 2.1 time: 0.089454 Aug 12 12:28:05.070824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 631/1237] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:04 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1513 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:05.557066 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:05.557676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:05.564665 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:05.565159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:05.565585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:05.566295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:05.566773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:05.567189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:05.708033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:05.715606 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ceb88064-7fd2-46bc-be69-da7f164423c2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.162475 Aug 12 12:28:05.716176 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 607/1238] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:05 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:06.047551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:06.048160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:06.054612 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:06.055089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:06.055524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:06.056210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:06.056677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:06.057105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:06.091283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:06.092577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:06.098558 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:06.099035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:06.099467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:06.100155 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:06.100600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:06.101044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:06.130862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:06.131398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:06.131833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:06.132274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lazy-loading 'fault' on Instance uuid 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:28:06.180746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd28b2571a540e7bdd9c15684dee82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478411e9884545398aa7fbec4279a57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:06.188422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e85af139-d6a3-46c8-b995-efceb9d66f8d tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 200 len: 1349 microversion: 2.1 time: 0.100923 Aug 12 12:28:06.189018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 608/1239] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:06 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:28:06.211766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:06.219335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3802efcf-e639-488e-919d-3649530d89f6 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1507 microversion: 2.1 time: 0.175859 Aug 12 12:28:06.219895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 632/1240] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:06 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:06.737530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:06.738133 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:06.744596 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:06.745096 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:06.745528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:06.746210 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:06.746653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:06.747074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:06.965355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:06.979117 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a148f85b-d79a-45ed-800b-834f22389c11 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.240640 Aug 12 12:28:06.979117 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 609/1241] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:06 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:06.995119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-241015a3-3711-43a9-a66e-f638aad0fa58 req-26c4e432-53fd-4c45-afe6-624f702f83a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310fc6f6-2f0e-4103-ab14-95e4175018d6", "name": "network-vif-deleted", "tag": "50da9c0c-6eaf-494f-acc6-dc0530095799"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:07.016373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-241015a3-3711-43a9-a66e-f638aad0fa58 req-26c4e432-53fd-4c45-afe6-624f702f83a9 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:07.016927 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-241015a3-3711-43a9-a66e-f638aad0fa58 req-26c4e432-53fd-4c45-afe6-624f702f83a9 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:07.017358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-241015a3-3711-43a9-a66e-f638aad0fa58 req-26c4e432-53fd-4c45-afe6-624f702f83a9 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:07.032518 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-241015a3-3711-43a9-a66e-f638aad0fa58 req-26c4e432-53fd-4c45-afe6-624f702f83a9 service nova] Creating event network-vif-deleted:50da9c0c-6eaf-494f-acc6-dc0530095799 for instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 on hv-cinder-79797 Aug 12 12:28:07.037487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-241015a3-3711-43a9-a66e-f638aad0fa58 req-26c4e432-53fd-4c45-afe6-624f702f83a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046802 Aug 12 12:28:07.038735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 633/1242] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:28:07.211094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:07.211874 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] [instance: 8c2cbb43-b41e-4e49-9529-e0f7db8b3079] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:07.218602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:07.219171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:07.219668 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:07.220435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:07.220977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:07.221464 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:07.236219 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] HTTP exception thrown: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 could not be found. Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Request method failure captured: Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 HTTP/1.1 Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kX_oDmVMLouKzyJF3JxehlCJ2lw4z23c7LOH2uvlwV-a4EV7d03pWkTbWaadoRK5Ngp0nS0Lc6gN8ZN2M1azmAWQNAmajuwHK8v8P7RkwEPKaiCk-yDI7KyX9bjwMmyyN0sOh230CFSZe68nT7-vo-ekFSP_C9ocwjAr7iK7wPZ_pI Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 478411e9884545398aa7fbec4279a57b Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestMinimumBasicScenario-419669766 Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:28:07.237920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/478411e9884545398aa7fbec4279a57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/478411e9884545398aa7fbec4279a57b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_478411e9884545398aa7fbec4279a57b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/478411e9884545398aa7fbec4279a57b"}]}] Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestMinimumBasicScenario-419669766 Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 478411e9884545398aa7fbec4279a57b Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestMinimumBasicScenario-419669766 Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-TestMinimumBasicScenario-419669766-project Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: fbd28b2571a540e7bdd9c15684dee82d Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestMinimumBasicScenario-419669766-project Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 could not be found. Aug 12 12:28:07.239587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '8c2cbb43-b41e-4e49-9529-e0f7db8b3079'} Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 could not be found. Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:28:07.240416 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 could not be found. Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 could not be found. Aug 12 12:28:07.241702 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:07.242813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Returning 404 to user: Instance 8c2cbb43-b41e-4e49-9529-e0f7db8b3079 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:28:07.242813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7a53bda0-9802-4af9-b5d7-a421a62ad904 tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079" status: 404 len: 111 microversion: 2.1 time: 0.032472 Aug 12 12:28:07.242813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 610/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:07 2022] GET /compute/v2.1/servers/8c2cbb43-b41e-4e49-9529-e0f7db8b3079 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:28:07.243761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:07.244479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:07.249154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ede68814-39b2-49ee-98bb-27383e05389b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] Calling method '.version_select at 0x7f9914236af0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:07.252610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:07.253372 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:07.254901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:07.255631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:07.256256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:07.256795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:07.328489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:07.336631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ede68814-39b2-49ee-98bb-27383e05389b tempest-TestMinimumBasicScenario-419669766 tempest-TestMinimumBasicScenario-419669766-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1228588657" status: 202 len: 0 microversion: 2.1 time: 0.091848 Aug 12 12:28:07.337553 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 611/1244] 10.222.0.27 () {58 vars in 1272 bytes} [Fri Aug 12 12:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1228588657 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:28:07.337937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2720b455-f68c-4224-94b7-1bbeda1c799b tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 200 len: 1293 microversion: 2.1 time: 0.102205 Aug 12 12:28:07.339002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 634/1245] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:07 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:28:07.995756 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:07.996369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:08.003747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:08.004283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:08.004678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:08.005377 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:08.005841 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:08.006266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:08.143407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:08.150966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-35132b71-3db2-4040-bf10-dc0829253a6d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.159590 Aug 12 12:28:08.151528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 612/1246] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:07 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:08.358965 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:08.359598 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 310fc6f6-2f0e-4103-ab14-95e4175018d6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:08.366072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:08.366553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:08.366989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:08.367677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:08.368131 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:08.368543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:08.382746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] HTTP exception thrown: Instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 could not be found. Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Request method failure captured: Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 HTTP/1.1 Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU1XxsYk5VN_T93GFCyU7RYD5hJ0BUvCvlf_XfH6CNe7so5BnwxxiAMNAPR3AFdodLdusZpG2dRuzFwRh-WoYlJ9uzjtmndJ9XnlnxpvjQSOcEwevrL5RQryb0o3Z3JjmOG4-zKB_4aZsdhzluBi1_8emtWcCSYZ8JlpKE6IFVAs9c Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:28:08.384382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e8def85acdd4e308bb51b4063c2ab4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}] Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 099b87a6c6b8409ab188c0b71ded7f55 Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 could not be found. Aug 12 12:28:08.390781 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '310fc6f6-2f0e-4103-ab14-95e4175018d6'} Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 could not be found. Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:28:08.391676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 could not be found. Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 could not be found. Aug 12 12:28:08.393151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:28:08.394492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Returning 404 to user: Instance 310fc6f6-2f0e-4103-ab14-95e4175018d6 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:28:08.394492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-433f1c59-8c9c-4662-a475-2ef4b861baba tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6" status: 404 len: 111 microversion: 2.1 time: 0.030731 Aug 12 12:28:08.394492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 635/1247] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:08 2022] GET /compute/v2.1/servers/310fc6f6-2f0e-4103-ab14-95e4175018d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:28:08.395084 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:08.395574 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:08.401612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:08.402088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:08.402524 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:08.403199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:08.403645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:08.404064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:08.430510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:28:08.653874 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1c04248d-483e-490d-be22-cf03f7515100 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 204 len: 0 microversion: 2.1 time: 0.262109 Aug 12 12:28:08.654876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 613/1248] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:28:08 2022] DELETE /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:28:08.662714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:08.663326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:08.670169 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:08.670743 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:08.671181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:08.671867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:08.672309 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:08.672752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:08.808967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:08.817937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-de5062d6-5e24-457c-b64e-57ab5feb87c3 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.159056 Aug 12 12:28:08.818532 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 636/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:08 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:09.178210 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:09.179070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:09.181619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:09.187518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:09.188742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:09.188742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:09.189375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:09.189832 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:09.190250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:09.330502 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:09.338447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f1959f02-f85e-4993-a1d6-94983556b508 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.164700 Aug 12 12:28:09.339168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 614/1250] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:09 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:09.839494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:09.840290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:09.848336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:09.849015 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:09.849563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:09.850389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:09.850952 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:09.851482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:10.022635 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:10.031489 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c6da664a-0c66-475e-8000-91518f2daf32 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1520 microversion: 2.1 time: 0.195898 Aug 12 12:28:10.032180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 637/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:09 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:10.361966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:10.363180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:10.370369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:10.370915 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:10.371352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:10.372047 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:10.372496 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:10.373034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:10.596743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:10.598749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-68790f2d-5fb5-4b0a-b014-516c25681742 req-4b721b74-c478-40b3-bf16-98051bee7099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3556b5-b492-4712-ae79-c1cfea75596f", "name": "network-vif-deleted", "tag": "9616b601-7daa-4021-942a-ba6e7e79bf24"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:10.604866 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-86e6719e-aa3a-49f9-af0f-8158a2c5c8f9 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.247781 Aug 12 12:28:10.615123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-68790f2d-5fb5-4b0a-b014-516c25681742 req-4b721b74-c478-40b3-bf16-98051bee7099 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:10.615123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-68790f2d-5fb5-4b0a-b014-516c25681742 req-4b721b74-c478-40b3-bf16-98051bee7099 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:10.615123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-68790f2d-5fb5-4b0a-b014-516c25681742 req-4b721b74-c478-40b3-bf16-98051bee7099 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:10.617432 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 615/1252] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:10 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:10.630941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-68790f2d-5fb5-4b0a-b014-516c25681742 req-4b721b74-c478-40b3-bf16-98051bee7099 service nova] Creating event network-vif-deleted:9616b601-7daa-4021-942a-ba6e7e79bf24 for instance 2e3556b5-b492-4712-ae79-c1cfea75596f on hv-cinder-79797 Aug 12 12:28:10.636162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-68790f2d-5fb5-4b0a-b014-516c25681742 req-4b721b74-c478-40b3-bf16-98051bee7099 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044221 Aug 12 12:28:10.639979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 638/1253] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:28:11.052168 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:11.052806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:11.059038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:11.059517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:11.059947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:11.060731 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:11.061136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:11.061667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:11.093256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:11.093740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:11.094175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:11.094617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lazy-loading 'fault' on Instance uuid 2e3556b5-b492-4712-ae79-c1cfea75596f {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:28:11.097565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:11.137825 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099b87a6c6b8409ab188c0b71ded7f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8def85acdd4e308bb51b4063c2ab4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:11.146146 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b0780d0d-d439-49e4-b4db-4dec75adb139 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 200 len: 1311 microversion: 2.1 time: 0.098013 Aug 12 12:28:11.146709 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 616/1254] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:11 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:11.629416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:11.630034 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:11.636392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:11.636915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:11.637350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:11.638054 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:11.638504 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:11.639792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:11.814498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:11.823212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-23e9ee0f-f10c-4c76-b2ed-fdde621e5ea3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.198977 Aug 12 12:28:11.834517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 639/1255] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:11 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:12.167413 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:12.168115 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] [instance: 2e3556b5-b492-4712-ae79-c1cfea75596f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:12.176499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:12.177279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:12.177721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:12.178523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:12.179097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:12.179597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:12.194995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] HTTP exception thrown: Instance 2e3556b5-b492-4712-ae79-c1cfea75596f could not be found. Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Request method failure captured: Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f HTTP/1.1 Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU1XxsYk5VN_T93GFCyU7RYD5hJ0BUvCvlf_XfH6CNe7so5BnwxxiAMNAPR3AFdodLdusZpG2dRuzFwRh-WoYlJ9uzjtmndJ9XnlnxpvjQSOcEwevrL5RQryb0o3Z3JjmOG4-zKB_4aZsdhzluBi1_8emtWcCSYZ8JlpKE6IFVAs9c Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:28:12.196827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e8def85acdd4e308bb51b4063c2ab4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e8def85acdd4e308bb51b4063c2ab4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e8def85acdd4e308bb51b4063c2ab4e"}]}] Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 2e8def85acdd4e308bb51b4063c2ab4e Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1278774362 Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 099b87a6c6b8409ab188c0b71ded7f55 Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1278774362-project Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 2e3556b5-b492-4712-ae79-c1cfea75596f could not be found. Aug 12 12:28:12.198423 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '2e3556b5-b492-4712-ae79-c1cfea75596f'} Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3556b5-b492-4712-ae79-c1cfea75596f could not be found. Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:28:12.199262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3556b5-b492-4712-ae79-c1cfea75596f could not be found. Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3556b5-b492-4712-ae79-c1cfea75596f could not be found. Aug 12 12:28:12.200737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:12.203046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] Returning 404 to user: Instance 2e3556b5-b492-4712-ae79-c1cfea75596f could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:28:12.203046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5fc61fb0-6ebb-475b-8a23-55c6f1c5d0d7 tempest-ServerRescueNegativeTestJSON-1278774362 tempest-ServerRescueNegativeTestJSON-1278774362-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f" status: 404 len: 111 microversion: 2.1 time: 0.034784 Aug 12 12:28:12.203046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 617/1256] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:12 2022] GET /compute/v2.1/servers/2e3556b5-b492-4712-ae79-c1cfea75596f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:28:12.846445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:12.847310 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:12.854105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:12.854742 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:12.855328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:12.856106 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:12.856676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:12.857265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:13.122320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:13.131016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4c2575da-e8c1-4c9f-95a8-e30b83c52fb5 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.288562 Aug 12 12:28:13.131599 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 640/1257] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:12 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:14.151567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:14.152969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:14.162198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:14.163228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:14.164029 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:14.164972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:14.165861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:14.166514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:14.580025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:14.588801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ceb6ba18-a1cf-4919-891f-2e6105c52d98 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.441042 Aug 12 12:28:14.593912 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 618/1258] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:14 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:15.612335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:15.612980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:15.632270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:15.632943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:15.633469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:15.634369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:15.634892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:15.635515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:15.917574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:15.936867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e05fd5c8-bafa-4a31-9d5a-66ed4b824b1c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.319663 Aug 12 12:28:15.936867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 641/1259] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:15 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:16.952953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:16.958482 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:16.963216 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:16.964058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:16.964794 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:16.965876 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:16.967579 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:16.968230 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:17.110418 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:17.118183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d1c8832e-26ef-4972-b383-1f1d9fc921a3 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.172425 Aug 12 12:28:17.120338 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 619/1260] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:16 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:18.147324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:18.149881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:18.155549 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:18.156029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:18.156464 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:18.157188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:18.157638 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:18.158134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:18.306136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:18.315619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0a8c971e-fb5a-4d0a-ac84-0685b39e2e65 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.171994 Aug 12 12:28:18.316061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 642/1261] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:18 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:19.337534 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:19.338255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:19.345370 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:19.345847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:19.346282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:19.346961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:19.347404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:19.347819 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:19.478828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:19.486788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a12a3abe-24d0-4caa-9a73-4ecb9b309013 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.153020 Aug 12 12:28:19.487358 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 620/1262] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:19 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:20.506970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:20.507598 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:20.514152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:20.514634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:20.515073 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:20.515796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:20.516250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:20.516726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:20.648650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:20.656680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-40a96d75-70d5-4bcb-a066-7352415e6a46 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.153658 Aug 12 12:28:20.657247 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 643/1263] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:20 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:21.676824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:21.677436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:21.683989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:21.684494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:21.684960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:21.685945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:21.686435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:21.686860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:21.847149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:21.855100 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-819bad8f-511d-4b37-8c62-790729ce38cc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.182183 Aug 12 12:28:21.855920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 621/1264] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:21 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:22.877279 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:22.877895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:22.880237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:22.887336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:22.887336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:22.887336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:22.887336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:22.887700 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:22.888045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:23.023155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:23.030945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-aeae84c4-681f-4952-ba07-905bfa65b78b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1508 microversion: 2.1 time: 0.158205 Aug 12 12:28:23.031729 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 644/1265] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:22 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:23.051713 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:23.052367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:23.058858 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:23.059341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:23.059872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:23.060566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:23.061584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:23.062007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:23.091740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121153) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 12:28:23.358834 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ded223d9-826d-4b08-a08d-2d05086a0178 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "POST /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743/action" status: 202 len: 0 microversion: 2.1 time: 0.310869 Aug 12 12:28:23.359454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 622/1266] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 12 12:28:23 2022] POST /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:28:23.367510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:23.368767 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:23.376839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:23.377133 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:23.377596 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:23.378870 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:23.378972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:23.379365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:23.523200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:23.536757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ff5ed14b-c399-4104-b904-2e602a851f45 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1516 microversion: 2.1 time: 0.168593 Aug 12 12:28:23.536757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 645/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:23 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:23.843021 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-b97ceb01-833c-441a-b4b0-5b1317f5b635 req-5593028c-9b82-421c-8d89-5ce5ece26906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5591717-7940-402d-a1b0-737ee67b0743", "name": "network-vif-unplugged", "status": "completed", "tag": "8730add4-d37a-43c9-83e1-97a8314f1259"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:23.853990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b97ceb01-833c-441a-b4b0-5b1317f5b635 req-5593028c-9b82-421c-8d89-5ce5ece26906 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:23.854455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b97ceb01-833c-441a-b4b0-5b1317f5b635 req-5593028c-9b82-421c-8d89-5ce5ece26906 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:23.855064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b97ceb01-833c-441a-b4b0-5b1317f5b635 req-5593028c-9b82-421c-8d89-5ce5ece26906 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:23.867796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.compute.server_external_events [req-b97ceb01-833c-441a-b4b0-5b1317f5b635 req-5593028c-9b82-421c-8d89-5ce5ece26906 service nova] Unable to find a host for instance c5591717-7940-402d-a1b0-737ee67b0743. Dropping event network-vif-unplugged {{(pid=121153) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 12:28:23.868809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-b97ceb01-833c-441a-b4b0-5b1317f5b635 req-5593028c-9b82-421c-8d89-5ce5ece26906 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031987 Aug 12 12:28:23.869418 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 623/1268] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 12 12:28:24.562116 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:24.562904 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:24.569644 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:24.623056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:24.623056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:24.623056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:24.623056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:24.623826 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:24.753203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:24.755550 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:24.763583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0c72a03f-e4bc-4a8e-baeb-f01f41862c61 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1516 microversion: 2.1 time: 0.204356 Aug 12 12:28:24.763583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 646/1269] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:24 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:25.784064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:25.784707 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:25.791197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:25.791677 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:25.792109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:25.793065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:25.793517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:25.793940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:25.942164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:25.949834 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-08c657ec-2afe-46d5-82d6-9e6f3beac39d tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1518 microversion: 2.1 time: 0.170052 Aug 12 12:28:25.950385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 624/1270] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:25 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:26.971759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:26.972328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:26.979472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:26.979944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:26.980576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:26.981281 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:26.981725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:26.982143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:27.195599 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:27.204087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b3b059a5-0c86-4fcc-a5aa-6487d82bf999 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.236333 Aug 12 12:28:27.204601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 647/1271] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:26 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:28.225433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:28.226074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:28.232572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:28.233247 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:28.233788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:28.234479 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:28.234933 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:28.235355 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:28.369930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:28.377793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-03aee7f1-f2cf-4460-9073-c29a7979396c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.156304 Aug 12 12:28:28.383490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 625/1272] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:28 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:29.400723 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:29.400723 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:29.407431 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:29.407918 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:29.408352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:29.409076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:29.409524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:29.409945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:29.552296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:29.561327 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1ceef4be-1ae8-41cd-9f30-03d406338baa tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.164910 Aug 12 12:28:29.564146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 648/1273] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:29 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:30.591623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:30.592970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:30.599198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:30.599670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:30.600103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:30.600916 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:30.601358 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:30.601772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:30.740443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:30.747780 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-59f425f7-6c5d-4148-af86-76be43e9c71c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.160324 Aug 12 12:28:30.748356 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 626/1274] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:30 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:31.768850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:31.769618 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:31.775996 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:31.776479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:31.777119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:31.777812 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:31.778268 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:31.778696 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:31.919799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:31.928587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f0e3f99b-ba2d-4d3b-aa18-b7ea7b6d2e1b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.163683 Aug 12 12:28:31.929197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 649/1275] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:31 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:32.950212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:32.950814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:32.958044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:32.958521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:32.958952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:32.959630 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:32.960090 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:32.960503 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:33.091422 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:33.099675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9e1c4348-580f-4661-82d4-11b288a939dc tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.153283 Aug 12 12:28:33.100239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 627/1276] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:32 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:34.120873 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:34.121482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:34.128229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:34.128745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:34.129182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:34.129862 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:34.130312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:34.130733 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:34.263766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:34.271381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-eab8c60f-0195-437b-bb2f-5e2cbb6efab6 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.154430 Aug 12 12:28:34.271962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 650/1277] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:34 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:35.292966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:35.293592 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:35.300800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:35.301310 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:35.301748 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:35.302434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:35.302883 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:35.303303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:35.432952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:35.441057 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2a71c6b9-aa42-4cd9-8c35-e87f8b0cc429 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.151831 Aug 12 12:28:35.441615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 628/1278] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:35 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:36.462030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:36.462639 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:36.469127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:36.469836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:36.470356 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:36.471059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:36.471520 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:36.472601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:36.608511 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:36.618271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4cb00e03-d0eb-4f2b-9b90-0af931091aca tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.160090 Aug 12 12:28:36.619130 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 651/1279] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:36 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:37.641106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:37.641647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:37.648687 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:37.649171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:37.649606 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:37.650293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:37.650743 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:37.651165 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:37.782189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:37.789919 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9521e9b4-1854-4cd3-a192-51641226f7c4 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.152817 Aug 12 12:28:37.790489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 629/1280] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:37 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:38.811444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:38.812045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:38.818972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:38.819458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:38.819891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:38.820580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:38.821053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:38.821474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:38.957747 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:38.967155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e056058b-7316-417a-8714-6531dff9240c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.159692 Aug 12 12:28:38.967725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 652/1281] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:38 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:39.957120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-71a656b7-b26c-49c1-a0b9-ebf7747e6f33 req-5ab1ce93-c8a8-4260-b4d3-e23f5c3b4a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5591717-7940-402d-a1b0-737ee67b0743", "name": "network-vif-plugged", "status": "completed", "tag": "8730add4-d37a-43c9-83e1-97a8314f1259"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:39.962442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:39.967643 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-71a656b7-b26c-49c1-a0b9-ebf7747e6f33 req-5ab1ce93-c8a8-4260-b4d3-e23f5c3b4a7e service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:39.968106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-71a656b7-b26c-49c1-a0b9-ebf7747e6f33 req-5ab1ce93-c8a8-4260-b4d3-e23f5c3b4a7e service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:39.968527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-71a656b7-b26c-49c1-a0b9-ebf7747e6f33 req-5ab1ce93-c8a8-4260-b4d3-e23f5c3b4a7e service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:39.980742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-71a656b7-b26c-49c1-a0b9-ebf7747e6f33 req-5ab1ce93-c8a8-4260-b4d3-e23f5c3b4a7e service nova] Creating event network-vif-plugged:8730add4-d37a-43c9-83e1-97a8314f1259 for instance c5591717-7940-402d-a1b0-737ee67b0743 on hv-cinder-79797 Aug 12 12:28:39.986737 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-71a656b7-b26c-49c1-a0b9-ebf7747e6f33 req-5ab1ce93-c8a8-4260-b4d3-e23f5c3b4a7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 Aug 12 12:28:39.987733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 630/1282] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:28:39.990260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:39.990815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:39.997350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:39.997830 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:39.998268 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:39.998951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:39.999399 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:39.999818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:40.142939 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:40.151800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-39190eb0-802a-4e57-9093-e591d2dda41c tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.166154 Aug 12 12:28:40.162137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 653/1283] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:39 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:28:41.175651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:41.176354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:41.183305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:41.183786 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:41.184221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:41.184941 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:41.185388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:41.185816 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:41.320476 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:41.327918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c450f328-f84b-4138-8dd9-9a668eaaeb54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1574 microversion: 2.1 time: 0.156965 Aug 12 12:28:41.328612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 631/1284] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:41 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:42.351295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:42.351925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:42.358720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:42.359202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:42.359647 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:42.360328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:42.360852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:42.361273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:42.501533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:42.501533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-948fac21-76d3-453f-960d-909665a1716b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1561 microversion: 2.1 time: 0.154564 Aug 12 12:28:42.502160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 654/1285] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:42 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:42.583995 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:42.584548 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:42.591250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:42.591733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:42.592173 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:42.592918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:42.593375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:42.593827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:42.620667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5286d31d-c9b1-4829-88c4-7002ddfb5464 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/ips" status: 200 len: 148 microversion: 2.1 time: 0.038187 Aug 12 12:28:42.620667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 632/1286] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:28:42 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:28:45.307123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d64d458-5703-4c66-9864-c35093e9b22e"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:45.309535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:45.316601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:45.317107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:45.317537 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:45.318211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:45.318662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:45.319081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:46.054541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c25e72d5-599b-45aa-a25a-2131ed615111 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750724 Aug 12 12:28:46.055168 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 655/1287] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:28:45 2022] POST /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:28:52.644919 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:52.646136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:52.648589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=5 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:52.649332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:52.654017 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:52.654490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:52.654919 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:52.655595 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:52.656043 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:52.656467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:52.682074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8a1fee32-b6a1-4c83-92f0-a433ebd81fcb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/ips" status: 200 len: 153 microversion: 2.20 time: 0.041007 Aug 12 12:28:52.682566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 633/1288] 10.222.0.27 () {60 vars in 1289 bytes} [Fri Aug 12 12:28:52 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:28:54.541650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:54.543998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:54.546571 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=24 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:54.553141 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:54.553141 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:54.553141 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:54.553683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:54.554146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:54.554579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:54.583344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e48ae5d6-9ac7-4a95-8e80-a2118c28a65a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046628 Aug 12 12:28:54.584923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 656/1289] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:28:54 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:28:54.647128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:54.647627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:54.654597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:54.658150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:54.658150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:54.658150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:54.658150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:54.658546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:54.682376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:28:55.008917 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-431e1aeb-58bd-4f0b-a14f-4844fdc49885 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 204 len: 0 microversion: 2.1 time: 0.366600 Aug 12 12:28:55.009512 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 634/1290] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:28:54 2022] DELETE /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:28:55.018148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:55.018878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:55.026116 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:55.026597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:55.027031 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:55.027715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:55.028160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:55.028691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:55.316535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:55.324857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-73e6c8e4-8b38-4eec-a786-6f59536a5916 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1672 microversion: 2.1 time: 0.310611 Aug 12 12:28:55.325438 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 657/1291] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:55 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1672 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:56.147291 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:56.147970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:56.154343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.154830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.155271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.155988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.156443 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.156902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.179537 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lazy-loading 'flavor' on Instance uuid d7f15496-02a4-4b9a-838c-16a09258073a {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:28:56.347347 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:56.348109 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:56.356531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.357061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.357502 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.358232 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.358691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.359295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.494662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:56.503958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2c572acf-c3c6-47fe-8ac7-5a5e4159e7fa tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1672 microversion: 2.1 time: 0.159860 Aug 12 12:28:56.503958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 658/1292] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:56 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:28:56.723154 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-df741a56-614d-4349-8b76-fc37e43df1ef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/action" status: 202 len: 0 microversion: 2.20 time: 0.579969 Aug 12 12:28:56.723581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 635/1293] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Aug 12 12:28:56 2022] POST /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:28:56.732655 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:56.733348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:56.739150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.739631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.744615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.744615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.744615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.744615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.753545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d64d458-5703-4c66-9864-c35093e9b22e"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:56.756762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:56.762941 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.763479 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.769642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.769642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.769642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.769642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.863192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Invalid volume: volume 0d64d458-5703-4c66-9864-c35093e9b22e is already attached to instances: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: POST /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments HTTP/1.1 Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 74 Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:28:56.865888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {"volumeAttachment": {"volumeId": "0d64d458-5703-4c66-9864-c35093e9b22e"}} Aug 12 12:28:56.872037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Invalid volume: volume 0d64d458-5703-4c66-9864-c35093e9b22e is already attached to instances: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'server_id': '16ebc13e-bbe5-467e-9a7f-d58a333c5b09', 'body': {'volumeAttachment': {'volumeId': '0d64d458-5703-4c66-9864-c35093e9b22e'}}} Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0d64d458-5703-4c66-9864-c35093e9b22e is already attached to instances: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:56.872957 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0d64d458-5703-4c66-9864-c35093e9b22e is already attached to instances: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:28:56.874505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:28:56.876022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:28:56.876022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:28:56.876022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:28:56.876022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0d64d458-5703-4c66-9864-c35093e9b22e is already attached to instances: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 Aug 12 12:28:56.876022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:28:56.876022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 400 to user: Invalid volume: volume 0d64d458-5703-4c66-9864-c35093e9b22e is already attached to instances: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:28:56.876022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f0213b68-23d1-4d70-b13b-2bd3e6bb5b1d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118377 Aug 12 12:28:56.876022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 636/1294] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:28:56 2022] POST /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 12 12:28:56.921555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:56.930486 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:56.932078 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:56.933376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-56fc828d-a86d-4c0f-bfd3-917a474fc609 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.204952 Aug 12 12:28:56.934096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 659/1295] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:28:56 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:28:56.941545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:56.942190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:56.949956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.950448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.950909 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:56.951623 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:56.952284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:56.952774 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:57.035805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lazy-loading 'services' on Instance uuid 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:28:57.260942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-71d9c7a0-cee3-4eef-95e0-c682f31a9358 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments/0d64d458-5703-4c66-9864-c35093e9b22e" status: 202 len: 0 microversion: 2.1 time: 0.323393 Aug 12 12:28:57.263307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 637/1296] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:28:56 2022] DELETE /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments/0d64d458-5703-4c66-9864-c35093e9b22e => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:28:57.271492 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:57.274059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:57.280447 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:57.281071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:57.281499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:57.282219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:57.282662 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:57.283108 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:57.288600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:28:57.317751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3a37fe5c-6e10-42cb-9f4e-f3b568e422d5 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051769 Aug 12 12:28:57.319952 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 660/1297] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:28:57 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:28:57.526521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:57.527223 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:57.533467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:57.533949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:57.534430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:57.535144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:57.535597 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:57.536026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:57.959838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:57.963237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:57.964529 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:57.972249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:57.973085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:57.973739 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:57.975254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:57.976179 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:57.977104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:57.983051 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4007f27c-916b-4dfe-bc59-2f265e920cfc tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1604 microversion: 2.1 time: 0.461098 Aug 12 12:28:57.989529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 638/1298] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:57 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1604 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:58.201375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:58.248426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-f55ef9bc-f511-468c-bc66-e8fdcd3a4a6e req-d591d73a-eab6-46a0-b089-a2942fe80561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f381d7-b452-42ba-a0f0-1b4b74c3e07a", "name": "network-vif-deleted", "tag": "6c4badc5-44f5-4d36-830c-0a3fb6d17014"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:28:58.255153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:58.265759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:58.269897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8cec2430-4c54-475b-8130-1ebf2be7b600 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.312000 Aug 12 12:28:58.287588 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 661/1299] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:28:57 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:28:58.290334 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f55ef9bc-f511-468c-bc66-e8fdcd3a4a6e req-d591d73a-eab6-46a0-b089-a2942fe80561 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:58.291895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f55ef9bc-f511-468c-bc66-e8fdcd3a4a6e req-d591d73a-eab6-46a0-b089-a2942fe80561 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:58.292758 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f55ef9bc-f511-468c-bc66-e8fdcd3a4a6e req-d591d73a-eab6-46a0-b089-a2942fe80561 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:58.306324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-f55ef9bc-f511-468c-bc66-e8fdcd3a4a6e req-d591d73a-eab6-46a0-b089-a2942fe80561 service nova] Creating event network-vif-deleted:6c4badc5-44f5-4d36-830c-0a3fb6d17014 for instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a on hv-cinder-79797 Aug 12 12:28:58.316860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-f55ef9bc-f511-468c-bc66-e8fdcd3a4a6e req-d591d73a-eab6-46a0-b089-a2942fe80561 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075490 Aug 12 12:28:58.316860 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 639/1300] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:28:58.330655 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:58.333006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:58.339943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:58.340709 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:58.347369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:58.347369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:58.347369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:58.347369 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:58.379596 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7093bc4e-3dca-4b99-a051-7ba1bc3e5091 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053245 Aug 12 12:28:58.380895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 662/1301] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:28:58 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:28:59.006034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:59.006840 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:59.013182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.013674 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.014110 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.014804 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.015258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.015684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.048309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.048833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.049272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.049732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lazy-loading 'fault' on Instance uuid 73f381d7-b452-42ba-a0f0-1b4b74c3e07a {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:28:59.096200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:59.105954 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7ce2cef0-a8bc-4c77-8703-fe18fcf0f270 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 200 len: 1327 microversion: 2.1 time: 0.104728 Aug 12 12:28:59.106534 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 640/1302] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:58 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:28:59.310041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:59.310850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:59.317312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.317786 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.318783 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.319800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.320283 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.320981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.391997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:59.394325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:59.402049 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.404228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.404228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.404554 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.404748 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.405482 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.447098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6be89c4c-bb0f-40a8-a59d-0865182f0442 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059358 Aug 12 12:28:59.447836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 641/1303] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:28:59 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 12:28:59.467954 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:59.472355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:59.474045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:59.476188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fd48feef-72e9-4ef1-be84-6562cc92c1a1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.170169 Aug 12 12:28:59.477456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 663/1304] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:28:59 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:28:59.524082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:59.524575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:59.530928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.531404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.531890 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.532590 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.533115 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.533538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.558239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:28:59.832468 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e960a23e-fccf-431e-aaf4-cd7bc011053f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 204 len: 0 microversion: 2.1 time: 0.312585 Aug 12 12:28:59.833097 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 642/1305] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:28:59 2022] DELETE /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 12:28:59.841833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:28:59.842473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:28:59.848751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.849912 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.850362 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.851104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:28:59.851557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:28:59.851983 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:28:59.977684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:28:59.985111 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c0a4cfb5-5503-4e7b-a06a-8fc03a52adf3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1679 microversion: 2.1 time: 0.147241 Aug 12 12:28:59.985687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 664/1306] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:28:59 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:00.127577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:00.128190 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:00.135137 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:00.135612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:00.136045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:00.136745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:00.137193 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:00.137610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:00.151258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] HTTP exception thrown: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Request method failure captured: Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a HTTP/1.1 Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kXAjg8lZU09N3kQqF9hd8yfT4dMy8G8653xyi8KHyQHUUUCeGV2VdI22C3CSXaxnstY53iVVWhXxSLyT_o9_0qdta1icNZe4o-Zp8oB1JDKc_N47o59AFt0AW807XM_-ggFc_cCr_dWPJhNUHwxVUviDgSN9FD68EOBipD3qyZ1z6U Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:29:00.153031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0fbadb872e74c57813900e5ebb6ac88", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}] Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: d3f9fac4e1de488b9964f988d238483a Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:29:00.154653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '73f381d7-b452-42ba-a0f0-1b4b74c3e07a'} Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:29:00.155766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:29:00.157295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:29:00.158831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Returning 404 to user: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:29:00.158831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-88ca2387-5d2d-438e-b255-dac0286c1ce2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 404 len: 111 microversion: 2.1 time: 0.031068 Aug 12 12:29:00.158831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 643/1307] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:00 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:29:00.162987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-50427e30-37ea-498e-9c4d-5b47a2a12b87 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '.version_select at 0x7f9917746a60>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:00.244038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-50427e30-37ea-498e-9c4d-5b47a2a12b87 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578463955" status: 202 len: 0 microversion: 2.1 time: 0.084777 Aug 12 12:29:00.244607 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 665/1308] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 12 12:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578463955 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 12:29:00.499746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:00.500368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:00.507694 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:00.508504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:00.509200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:00.510367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:00.511039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:00.512284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:00.662918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:00.666619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:00.671523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:00.673061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:00.674255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-26433b57-5979-457f-a6bb-a1676309cb3e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.178881 Aug 12 12:29:00.674810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 644/1309] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:00 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:01.007086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:01.007942 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:01.014506 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:01.014988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:01.015429 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:01.016123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:01.016576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:01.017032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:01.028084 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-850e6758-9993-446f-93ca-d706c320d575 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'create', calling method: .version_select at 0x7f9914055dc0>, body: {"keypair": {"name": "tempest-keypair-1385400484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEr6MEtMLc4jwgarg0RdgA1HUSqp5WpPYRJXhE2zS9hZnaN9BAfKFoqwr9c4/mTHJU+BiCoVBomBQf5Ety+KrJ+oBVVnGlfIWD5AGyMtKUUyahC8gYUNQmietrtXZ9rRAw=="}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:01.043878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-850e6758-9993-446f-93ca-d706c320d575 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Getting quotas for project c0fbadb872e74c57813900e5ebb6ac88. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:29:01.047742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-850e6758-9993-446f-93ca-d706c320d575 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Getting quotas for user d3f9fac4e1de488b9964f988d238483a and project c0fbadb872e74c57813900e5ebb6ac88. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:29:01.136265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-850e6758-9993-446f-93ca-d706c320d575 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112161 Aug 12 12:29:01.138053 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 645/1310] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:29:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:29:01.152184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:01.159788 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b6d14825-e669-461c-88d7-d0042110d08e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1679 microversion: 2.1 time: 0.157082 Aug 12 12:29:01.160357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 666/1311] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:01 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:01.698060 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:01.698673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:01.705398 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:01.705877 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:01.706387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:01.707009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:01.707460 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:01.707882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:01.838802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:01.846736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:01.848252 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:01.849528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-944eae93-10d6-4412-916c-7812936bdee6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.155508 Aug 12 12:29:01.850174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 646/1312] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:01 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:02.182319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:02.182894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:02.189401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:02.189887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:02.190312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:02.191004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:02.191457 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:02.191881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:02.322503 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:02.330849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-79e22214-1ab7-469c-bfaa-8f482d8ecabc tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1679 microversion: 2.1 time: 0.153215 Aug 12 12:29:02.331682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 667/1313] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:02 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:02.873761 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:02.874373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:02.881058 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:02.881543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:02.881974 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:02.882696 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:02.883144 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:02.883569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:03.085961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:03.093996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:03.095518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:03.096701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4f37dd1f-44fe-4393-9f6e-fe3346fe60fa tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.227098 Aug 12 12:29:03.097261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 647/1314] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:02 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:03.238037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-781932092", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b734a92-a8fa-4136-b234-6c77076a2fd0"}], "security_groups": [{"name": "tempest-securitygroup--233823274"}], "key_name": "tempest-keypair-1385400484", "user_data": "}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:03.351717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:03.354533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:03.362336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:03.362996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:03.363540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:03.364373 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:03.365039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:03.365570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:03.467344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:03.470067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.network.neutron [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] validate_networks() for [('7b734a92-a8fa-4136-b234-6c77076a2fd0', None, None, None, None, None)] {{(pid=121154) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:29:03.499751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8544db9b-9202-4333-949d-64a5b8a991c1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 200 len: 1612 microversion: 2.1 time: 0.152204 Aug 12 12:29:03.500581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 648/1315] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:03 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 1612 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:03.529003 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-b2aa1632-5ad2-46fb-be7c-ea3d24da112b req-1386db28-2e39-41c1-94bd-e5eec1ac1453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ebc13e-bbe5-467e-9a7f-d58a333c5b09", "name": "network-vif-deleted", "tag": "3d24aa22-05d1-4afa-a856-ecabf8b6b12f"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:03.541662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b2aa1632-5ad2-46fb-be7c-ea3d24da112b req-1386db28-2e39-41c1-94bd-e5eec1ac1453 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:03.542148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b2aa1632-5ad2-46fb-be7c-ea3d24da112b req-1386db28-2e39-41c1-94bd-e5eec1ac1453 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:03.542565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b2aa1632-5ad2-46fb-be7c-ea3d24da112b req-1386db28-2e39-41c1-94bd-e5eec1ac1453 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:03.558970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-b2aa1632-5ad2-46fb-be7c-ea3d24da112b req-1386db28-2e39-41c1-94bd-e5eec1ac1453 service nova] Creating event network-vif-deleted:3d24aa22-05d1-4afa-a856-ecabf8b6b12f for instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 on hv-cinder-79797 Aug 12 12:29:03.566003 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-b2aa1632-5ad2-46fb-be7c-ea3d24da112b req-1386db28-2e39-41c1-94bd-e5eec1ac1453 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064005 Aug 12 12:29:03.566595 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 649/1316] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:04.074714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Flavor limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:29:04.075132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Image limits 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:29:04.075782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Flavor pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:29:04.076189 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Image pref 0:0:0 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:29:04.076600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.virt.hardware [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:29:04.090705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:04.100992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:04.101541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:04.104040 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:04.105569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:04.106771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:04.121445 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:04.124670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:04.130277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:04.131292 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:04.131727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:04.132430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:04.133175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:04.133604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:04.134692 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Getting quotas for project c0fbadb872e74c57813900e5ebb6ac88. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:29:04.142355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Getting quotas for user d3f9fac4e1de488b9964f988d238483a and project c0fbadb872e74c57813900e5ebb6ac88. Resources: {'cores', 'ram', 'instances'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:29:04.159284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Going to run 1 instances... {{(pid=121154) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:29:04.162686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:29:04.277771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cf7e5102-b8fb-4d26-8b7e-9f74ffc98f58 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.044050 Aug 12 12:29:04.280169 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 668/1317] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:29:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:29:04.292432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4189216d-2a80-45ec-884e-a2e7800d64e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:04.293081 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4189216d-2a80-45ec-884e-a2e7800d64e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:04.389805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4189216d-2a80-45ec-884e-a2e7800d64e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:04.403442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4189216d-2a80-45ec-884e-a2e7800d64e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1237 microversion: 2.1 time: 0.115319 Aug 12 12:29:04.407346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 669/1318] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:04 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1237 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:04.407640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:04.417308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:04.420987 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:04.423056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5e969c39-c29a-45f5-85db-e615b39d93bf tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.306145 Aug 12 12:29:04.424361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 650/1319] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:04 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:29:04.525496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:04.526134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:04.532682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:04.533184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:04.533657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:04.534393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:04.534850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:04.535414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:04.549659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 HTTP/1.1 Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:29:04.551316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:29:04.553382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '16ebc13e-bbe5-467e-9a7f-d58a333c5b09'} Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:29:04.554286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:29:04.555982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:04.557384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:29:04.557384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-431ae16a-0727-4e15-9c7b-a335a4468568 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 404 len: 111 microversion: 2.1 time: 0.032861 Aug 12 12:29:04.557384 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 670/1320] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:04 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:29:04.563475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c50d3981-6d95-4a7b-bb1a-17ce19c2e8c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '.version_select at 0x7f991404c5e0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:04.696484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c50d3981-6d95-4a7b-bb1a-17ce19c2e8c0 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-863347557" status: 202 len: 0 microversion: 2.1 time: 0.137773 Aug 12 12:29:04.697159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 651/1321] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Aug 12 12:29:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-863347557 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:29:05.424656 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:05.425413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:05.432947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:05.433427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:05.433861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:05.434603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:05.435040 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:05.435732 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:05.446114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:05.446721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:05.453300 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:05.453776 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:05.454204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:05.454892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:05.455585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:05.456187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:05.519753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:05.528252 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2e2fced4-1120-4fc0-8d58-786e8b40e376 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1241 microversion: 2.1 time: 0.107406 Aug 12 12:29:05.529105 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 671/1322] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:05 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:05.534245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-853ff62c-cd5c-4d04-99b2-23917bed8ab7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: .version_select at 0x7f991772b0d0>, body: {"keypair": {"name": "tempest-keypair-763545851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTblrPiv8hftfbuPe6FGkU+J06s5LKYwh8Qf8q2yyVsqKEHfZgtVEMMEeNM8FwZ2VUcwROudaW+drZXIkyc7wCYEBqic2IYfLXfRuQWMfmzQ6HGw1LcXdOTznY9P6K5dw=="}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:05.550080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-853ff62c-cd5c-4d04-99b2-23917bed8ab7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:29:05.553979 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.quota [None req-853ff62c-cd5c-4d04-99b2-23917bed8ab7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for user 0156c689e109489d9265dd3dd4d5cfde and project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'key_pairs'} {{(pid=121154) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:29:05.617461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:05.625473 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:05.627018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:05.628158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9e1c4421-4282-4914-84f2-07c4f78c1dcc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.186653 Aug 12 12:29:05.628739 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 652/1323] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:05 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:29:05.662575 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-853ff62c-cd5c-4d04-99b2-23917bed8ab7 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131888 Aug 12 12:29:05.663168 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 672/1324] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 12 12:29:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:06.549604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:06.550508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:06.557771 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:06.558258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:06.558701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:06.559430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:06.559893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:06.560433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:06.664498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:06.672020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9dfd82fd-fd9a-4236-a167-cbdf0109708b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1297 microversion: 2.1 time: 0.126408 Aug 12 12:29:06.672582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 653/1325] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:06 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1297 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:06.908057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:06.908057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:06.913798 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:06.914302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:06.915007 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:06.915706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:06.916342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:06.916793 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:07.079940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:07.088956 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:07.093039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:07.093039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0121e671-92e2-402b-9b05-21940454d305 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.444760 Aug 12 12:29:07.093270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 673/1326] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:06 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:07.694580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:07.695312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:07.702349 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:07.702830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:07.703296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:07.704271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:07.704845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:07.705592 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:07.955622 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:07.963947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e82962da-a0bf-4460-9d2d-3eee5e6ffeba tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.273798 Aug 12 12:29:07.964528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 654/1327] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:07 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:08.119207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:08.119967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:08.126895 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:08.127380 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:08.127815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:08.128737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:08.129332 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:08.130229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:08.163320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-604192899", "imageRef": "67c94124-df7d-4e81-b45b-d7bf6e58c46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ab29f31-7915-471c-8e03-8b38ddd1a049"}], "security_groups": [{"name": "tempest-securitygroup--204018746"}], "key_name": "tempest-keypair-763545851", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:08.617030 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] validate_networks() for [('9ab29f31-7915-471c-8e03-8b38ddd1a049', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:29:08.703925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:08.713178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:08.715770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:08.716972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c1b7f43c-fee2-404b-8ed4-811f493b2d33 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.605486 Aug 12 12:29:08.717540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 674/1328] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:08 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:08.879993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-69d8176b-9f4e-4ef3-a2ea-56e52ee66db8 req-2c43163e-6cfc-454b-8421-f742e24b6d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a728a3db-f9b1-4ec6-8902-db5dca83f5e7", "tag": "03bba527-b569-45bb-b10f-6d96e751596f"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:08.889818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-69d8176b-9f4e-4ef3-a2ea-56e52ee66db8 req-2c43163e-6cfc-454b-8421-f742e24b6d87 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:08.890305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-69d8176b-9f4e-4ef3-a2ea-56e52ee66db8 req-2c43163e-6cfc-454b-8421-f742e24b6d87 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:08.890731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-69d8176b-9f4e-4ef3-a2ea-56e52ee66db8 req-2c43163e-6cfc-454b-8421-f742e24b6d87 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:08.902603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-69d8176b-9f4e-4ef3-a2ea-56e52ee66db8 req-2c43163e-6cfc-454b-8421-f742e24b6d87 service nova] Creating event network-changed:03bba527-b569-45bb-b10f-6d96e751596f for instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 on hv-cinder-79797 Aug 12 12:29:08.907774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-69d8176b-9f4e-4ef3-a2ea-56e52ee66db8 req-2c43163e-6cfc-454b-8421-f742e24b6d87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031442 Aug 12 12:29:08.908336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 675/1329] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:29:08.984791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:08.985736 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:08.994100 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:08.994732 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:08.995241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:08.996024 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:08.996474 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:08.996962 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:09.289583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:09.295708 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:29:09.296153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:29:09.296588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:29:09.297023 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:29:09.297132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-70f88900-7ce3-4230-a052-a9634cdcd314 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.316761 Aug 12 12:29:09.297470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:29:09.297680 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 676/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:08 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:09.306627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:09.307112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:09.307550 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:09.308360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:09.308854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:09.309282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:09.326947 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:29:09.331320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Getting quotas for user 0156c689e109489d9265dd3dd4d5cfde and project 3d79773c49d643fc8eb04d69aafb0b01. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:29:09.343261 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:29:09.345588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67c94124-df7d-4e81-b45b-d7bf6e58c46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:29:09.491826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-de3998f2-42b6-4c0a-b04c-c59e9b716975 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.332878 Aug 12 12:29:09.493257 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 655/1331] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:29:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 12:29:09.504457 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1a615ad8-847c-4f66-9ed8-2b7518e3ded2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:09.505222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1a615ad8-847c-4f66-9ed8-2b7518e3ded2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:09.611701 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1a615ad8-847c-4f66-9ed8-2b7518e3ded2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:09.618940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1a615ad8-847c-4f66-9ed8-2b7518e3ded2 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1240 microversion: 2.1 time: 0.118554 Aug 12 12:29:09.619511 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 677/1332] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:09 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:09.743200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:09.743833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:09.754020 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:09.754849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:09.755003 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:09.755801 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:09.756258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:09.757338 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:09.960248 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:09.970018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:09.972339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:09.973789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f6ad8d2f-a437-4956-9963-0f4002e36399 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.236269 Aug 12 12:29:09.974755 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 656/1333] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:09 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:10.317344 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:10.317949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:10.324955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:10.325435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:10.325864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:10.326541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:10.326987 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:10.327402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:10.456382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:10.464176 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7d0ddc7c-6d56-4393-8791-616005a4925d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.150781 Aug 12 12:29:10.464770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 678/1334] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:10 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:10.639685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:10.640322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:10.646435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:10.646961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:10.647376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:10.648074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:10.648505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:10.648961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:10.712337 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:10.719624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b94c90b4-3aab-4afe-bf4f-a4e2c6a37a2d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1244 microversion: 2.1 time: 0.083848 Aug 12 12:29:10.720177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 657/1335] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:10 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:10.997183 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:10.997712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:11.003574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:11.004046 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:11.004478 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:11.005179 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:11.005897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:11.006316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:11.131413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:11.139795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:11.141314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:11.142451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-55c6a427-4f4b-4cd0-af93-9bda69595626 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.149296 Aug 12 12:29:11.143005 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 679/1336] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:10 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:11.484870 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:11.485475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:11.491808 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:11.492949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:11.493383 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:11.494057 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:11.494847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:11.495269 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:11.622005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:11.629289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-11856fad-1cf0-4f28-b151-61759ee05c64 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.148592 Aug 12 12:29:11.629849 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 658/1337] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:11 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:11.740570 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:11.741133 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:11.747542 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:11.748014 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:11.748440 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:11.749146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:11.749589 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:11.750002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:11.815087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:11.822599 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2ad51931-2e6f-4361-b4af-6fd8fbc87c60 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1244 microversion: 2.1 time: 0.085923 Aug 12 12:29:11.823189 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 680/1338] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:11 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:12.165618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:12.166221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:12.172094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:12.172570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:12.173031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:12.173706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:12.174150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:12.174566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:12.306569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:12.314653 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:12.316221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:12.317414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-84e71c33-73b3-48e7-94d8-bfc5392a3743 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.156091 Aug 12 12:29:12.317975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 659/1339] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:12 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:12.650603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:12.651208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:12.657324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:12.657810 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:12.658249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:12.658958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:12.659413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:12.659837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:12.790923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:12.798469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f5118cec-ccf9-48b0-9ce4-9ba868aa5c68 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.152368 Aug 12 12:29:12.799032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 681/1340] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:12 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:12.843293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:12.843932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:12.850539 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:12.851025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:12.852066 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:12.852316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:12.852839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:12.853270 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:12.917357 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:12.924667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9f0a2937-0a5d-4a71-bb94-5d91f91ba821 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1292 microversion: 2.1 time: 0.085329 Aug 12 12:29:12.925251 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 660/1341] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:12 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:13.340296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:13.340963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:13.347261 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:13.355333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:13.355333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:13.355333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:13.355333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:13.355796 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:13.481132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:13.484338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:13.490988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:13.493196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:13.494741 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-204d756f-5675-4539-a6be-50b6af477f0c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.158611 Aug 12 12:29:13.495299 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 682/1342] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:13 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:13.820053 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:13.821238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:13.825122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:13.828854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:13.829338 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:13.829771 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:13.830744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:13.831196 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:13.831614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:13.945371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:13.947258 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:13.954199 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:13.954760 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:13.955264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:13.956280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:13.956892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:13.957351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:14.047052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:14.055178 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4ce9842a-d9a0-4c08-a13b-cb38f14ccd7d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1298 microversion: 2.1 time: 0.113913 Aug 12 12:29:14.055609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:14.068333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 683/1343] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:13 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:14.068543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-85dd11f4-ec69-48a7-bb06-9df88a0fc018 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.248609 Aug 12 12:29:14.068543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 661/1344] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:13 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:14.519015 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:14.519758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:14.521740 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:14.527202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:14.527687 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:14.528201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:14.529102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:14.529578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:14.530002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:14.721063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:14.730467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:14.732096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:14.734455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-611e0543-90a6-4098-8f8a-9eac8c3d7367 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1746 microversion: 2.20 time: 0.219095 Aug 12 12:29:14.735124 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 684/1345] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:14 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:15.076420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:15.077044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:15.084090 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:15.084578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:15.085037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:15.085726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:15.086187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:15.086766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:15.086892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:15.087451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:15.094313 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:15.094800 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:15.095227 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:15.095909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:15.096358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:15.096804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:15.377309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:15.384711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9d3b78a4-f6b9-41d0-ac24-224a846320c4 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.312411 Aug 12 12:29:15.385295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 662/1346] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:15 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:15.403778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:15.403778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-32c5b980-cbfc-474d-bfee-d02c58a470e3 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.314775 Aug 12 12:29:15.403778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 685/1347] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:15 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:15.522442 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-7d3de8f9-7d54-48c5-aef1-3f5878604120 req-45ac8567-e2a7-4204-8411-33dd4ac46e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae523448-7f85-49ed-8f0b-a6599b05c0cc", "tag": "db24a0ad-e1d3-43fb-94ed-9469356218c0"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:15.533711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7d3de8f9-7d54-48c5-aef1-3f5878604120 req-45ac8567-e2a7-4204-8411-33dd4ac46e6f service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:15.534183 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7d3de8f9-7d54-48c5-aef1-3f5878604120 req-45ac8567-e2a7-4204-8411-33dd4ac46e6f service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:15.534609 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7d3de8f9-7d54-48c5-aef1-3f5878604120 req-45ac8567-e2a7-4204-8411-33dd4ac46e6f service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:15.548882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-7d3de8f9-7d54-48c5-aef1-3f5878604120 req-45ac8567-e2a7-4204-8411-33dd4ac46e6f service nova] Creating event network-changed:db24a0ad-e1d3-43fb-94ed-9469356218c0 for instance ae523448-7f85-49ed-8f0b-a6599b05c0cc on hv-cinder-79797 Aug 12 12:29:15.553951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-7d3de8f9-7d54-48c5-aef1-3f5878604120 req-45ac8567-e2a7-4204-8411-33dd4ac46e6f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035399 Aug 12 12:29:15.554814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 663/1348] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:15.765259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:15.765777 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:15.771657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:15.772136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:15.772567 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:15.773265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:15.774239 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:15.774694 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:15.976226 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:15.984071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:15.985666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:15.986845 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4dce5b27-102d-4c1f-af8a-f838073a3ecb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1746 microversion: 2.20 time: 0.225532 Aug 12 12:29:15.988057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 686/1349] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:15 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1746 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:16.404867 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:16.409880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-877c45b9-4bfe-4f89-947e-8a8a60e9e813 req-17090750-c06d-4b79-877d-f24669d5cb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a728a3db-f9b1-4ec6-8902-db5dca83f5e7", "name": "network-vif-plugged", "status": "completed", "tag": "03bba527-b569-45bb-b10f-6d96e751596f"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:16.410399 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:16.423634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:16.427944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-877c45b9-4bfe-4f89-947e-8a8a60e9e813 req-17090750-c06d-4b79-877d-f24669d5cb54 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:16.428700 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:16.429382 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:16.430724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:16.431256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:16.431861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:16.436659 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-877c45b9-4bfe-4f89-947e-8a8a60e9e813 req-17090750-c06d-4b79-877d-f24669d5cb54 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:16.437106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-877c45b9-4bfe-4f89-947e-8a8a60e9e813 req-17090750-c06d-4b79-877d-f24669d5cb54 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:16.450693 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-877c45b9-4bfe-4f89-947e-8a8a60e9e813 req-17090750-c06d-4b79-877d-f24669d5cb54 service nova] Creating event network-vif-plugged:03bba527-b569-45bb-b10f-6d96e751596f for instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 on hv-cinder-79797 Aug 12 12:29:16.455845 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-877c45b9-4bfe-4f89-947e-8a8a60e9e813 req-17090750-c06d-4b79-877d-f24669d5cb54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056372 Aug 12 12:29:16.456552 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 664/1350] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:16.462890 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:16.464041 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:16.470842 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:16.471412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:16.471909 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:16.472604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:16.473113 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:16.473704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:16.888684 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:16.896179 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fb5b22de-ff4c-43a8-aeac-13480136efbe tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.495376 Aug 12 12:29:16.896877 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 687/1351] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:16 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:16.917409 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:16.925410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-37d2f0b3-6206-4502-9e20-9c17d41cf046 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.467403 Aug 12 12:29:16.925982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 665/1352] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:16 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:17.009498 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:17.010099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:17.015926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:17.016399 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:17.016873 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:17.017579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:17.018021 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:17.018444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:17.147191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:17.155519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:17.157037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:17.158172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3a272bc3-1e4e-415a-9b86-8e7d5c0bf8bb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1746 microversion: 2.20 time: 0.152940 Aug 12 12:29:17.158725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 688/1353] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:17 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:17.919617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:17.920224 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:17.926634 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:17.927109 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:17.927536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:17.928212 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:17.928675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:17.929094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:17.933733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:17.949143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:17.949754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:17.956401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:17.956916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:17.957352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:17.958039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:17.958613 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:17.959042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:18.105471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:18.113521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9c62738c-26dd-45ae-8d97-7b83cb5397ae tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.197728 Aug 12 12:29:18.114369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 666/1354] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:17 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:18.143653 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:18.146721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b49fa3e9-421f-499a-81d0-b58c9bed640f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.202072 Aug 12 12:29:18.147295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 689/1355] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:17 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:18.181263 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:18.181856 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:18.187719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:18.188204 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:18.188631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:18.189341 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:18.189793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:18.190218 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:18.315835 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:18.323686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:18.325243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:18.326389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-33b4d699-9161-41c3-bfcb-83aae8db0415 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1746 microversion: 2.20 time: 0.149600 Aug 12 12:29:18.327015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 667/1356] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:18 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:18.486114 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-958c5e83-32f1-4c6b-97cb-b028c3135405 req-cdee824b-6e3b-4e78-9f0a-bd41515ef12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f15496-02a4-4b9a-838c-16a09258073a", "name": "network-vif-plugged", "status": "completed", "tag": "49a4b862-501e-4f3a-8a03-2ad524857c12"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:18.491019 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:18.496246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-958c5e83-32f1-4c6b-97cb-b028c3135405 req-cdee824b-6e3b-4e78-9f0a-bd41515ef12b service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:18.496753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-958c5e83-32f1-4c6b-97cb-b028c3135405 req-cdee824b-6e3b-4e78-9f0a-bd41515ef12b service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:18.497196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-958c5e83-32f1-4c6b-97cb-b028c3135405 req-cdee824b-6e3b-4e78-9f0a-bd41515ef12b service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:18.509120 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-958c5e83-32f1-4c6b-97cb-b028c3135405 req-cdee824b-6e3b-4e78-9f0a-bd41515ef12b service nova] Creating event network-vif-plugged:49a4b862-501e-4f3a-8a03-2ad524857c12 for instance d7f15496-02a4-4b9a-838c-16a09258073a on hv-cinder-79797 Aug 12 12:29:18.514211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-958c5e83-32f1-4c6b-97cb-b028c3135405 req-cdee824b-6e3b-4e78-9f0a-bd41515ef12b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031854 Aug 12 12:29:18.514792 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 690/1357] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:19.134841 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:19.135478 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:19.142260 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:19.142747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:19.143174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:19.143882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:19.144357 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:19.144806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:19.169390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:19.170082 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:19.176308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:19.176848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:19.177277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:19.177956 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:19.178422 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:19.178837 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:19.316381 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:19.331239 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:19.334527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-37c05067-45c3-4220-9785-bcb228a95288 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.203876 Aug 12 12:29:19.335293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 668/1358] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:19 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:19.349581 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:19.350466 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:19.350937 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:19.353435 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=10 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:19.358367 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e6bf0e0b-25a9-425d-ae12-a0daef10adb4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.194731 Aug 12 12:29:19.358626 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:19.359441 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:19.359656 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 691/1359] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:19 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:19.359778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:19.360271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:19.360778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:19.367498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:19.488259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:19.497413 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:19.499320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:19.500706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-77fdc4b3-5788-4356-86b4-b5f77876a90f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1746 microversion: 2.20 time: 0.155334 Aug 12 12:29:19.501461 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 669/1360] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:19 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:29:20.357410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:20.357976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:20.360060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=14 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:20.365418 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:20.365896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:20.366334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:20.367030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:20.367519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:20.367946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:20.386143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:20.387528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:20.393288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:20.393773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:20.394208 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:20.394899 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:20.395352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:20.395785 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:20.567856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:20.576578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:20.576791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f9c94524-5fc3-4096-a3cd-123156230e5d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.222129 Aug 12 12:29:20.576791 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 692/1361] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:20 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:20.581584 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:20.582187 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:20.582730 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3321efd1-7fe0-409a-9d63-f0b2b64b61e0 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.200525 Aug 12 12:29:20.583298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 670/1362] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:20 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:20.588681 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:20.589331 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:20.589829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:20.590579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:20.591033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:20.591457 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:20.724750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:20.733327 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:20.734815 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:20.735946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-63b05de4-e56d-4b1c-83b6-3efbcac497ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.158198 Aug 12 12:29:20.736501 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 693/1363] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:20 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:21.597516 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:21.598124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:21.605824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:21.606305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:21.606441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:21.606875 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:21.607186 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:21.607459 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:21.607907 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:21.608332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:21.614402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:21.614889 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:21.615374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:21.616237 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:21.616627 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:21.617095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:21.839002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:21.840750 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:21.848962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4c5eaa13-775a-4b3c-ba1b-429bd6ad8227 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.255160 Aug 12 12:29:21.849150 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e9ea9610-706b-40c0-afbf-4d87454e8b4a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1362 microversion: 2.1 time: 0.247175 Aug 12 12:29:21.849696 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 694/1364] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:21 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:21.850482 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 671/1365] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:21 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:21.855146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:21.855980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:21.862214 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:21.864620 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:21.865276 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:21.865967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:21.866562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:21.867334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:22.012558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:22.021000 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:22.022752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:22.024266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6e450029-a092-43be-8542-95b21aaf8e55 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.173301 Aug 12 12:29:22.025036 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 695/1366] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:21 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:22.870868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:22.872691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:22.873099 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:22.875395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:22.884444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:22.885236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:22.885778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:22.886270 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:22.886840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:22.887567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:22.888087 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:22.888591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:22.889222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:22.891374 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:22.891997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:22.892799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:23.123788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:23.130365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:23.132182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-954b6586-b194-48bb-a53a-481c0df846d7 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1547 microversion: 2.1 time: 0.266199 Aug 12 12:29:23.135305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 672/1367] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:22 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1547 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:23.140617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:23.141434 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:23.148289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:23.149304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:23.149997 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:23.150869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:23.151477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:23.152385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:23.154464 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-338a2a09-ad5e-4535-aca8-233eb8488c22 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.287133 Aug 12 12:29:23.155127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 696/1368] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:22 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:23.159915 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:23.160400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:23.166959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:23.167459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:23.167891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:23.168600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:23.169561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:23.170091 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:23.311557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-34022543-9fab-44a9-b3cf-9e37595e42c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155310 Aug 12 12:29:23.323263 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 697/1369] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 12 12:29:23 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:23.367988 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:23.378322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:23.381495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:23.383026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0335b696-326b-4d8d-9c0e-c0d22f02b66f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.246185 Aug 12 12:29:23.383960 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 673/1370] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:23 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:24.179168 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:24.181477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:24.193727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:24.194579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:24.195305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:24.197090 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:24.199929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:24.203292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:24.376253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:24.391006 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8558ac32-58e3-4c2c-a3cc-3ba2b9ebfdc6 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.215894 Aug 12 12:29:24.391673 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 698/1371] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:24 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:24.412477 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:24.413214 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:24.421245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:24.421749 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:24.422642 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:24.423536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:24.424001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:24.424872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:24.448032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-94908935-1c1c-4e3a-9609-e1d3078ce887 req-4050d8c4-bfc3-49e6-94f2-c0de10a26be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a728a3db-f9b1-4ec6-8902-db5dca83f5e7", "tag": "03bba527-b569-45bb-b10f-6d96e751596f"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:24.472551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-94908935-1c1c-4e3a-9609-e1d3078ce887 req-4050d8c4-bfc3-49e6-94f2-c0de10a26be4 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:24.472551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-94908935-1c1c-4e3a-9609-e1d3078ce887 req-4050d8c4-bfc3-49e6-94f2-c0de10a26be4 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:24.472551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-94908935-1c1c-4e3a-9609-e1d3078ce887 req-4050d8c4-bfc3-49e6-94f2-c0de10a26be4 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:24.483080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-94908935-1c1c-4e3a-9609-e1d3078ce887 req-4050d8c4-bfc3-49e6-94f2-c0de10a26be4 service nova] Creating event network-changed:03bba527-b569-45bb-b10f-6d96e751596f for instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 on hv-cinder-79797 Aug 12 12:29:24.488151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-94908935-1c1c-4e3a-9609-e1d3078ce887 req-4050d8c4-bfc3-49e6-94f2-c0de10a26be4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044234 Aug 12 12:29:24.489394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 699/1372] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:24.495376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-28e2d88e-fb35-4cbc-8026-ed868069ea20 req-148355da-ce5b-4b74-ac3b-a0557cfd5b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae523448-7f85-49ed-8f0b-a6599b05c0cc", "name": "network-vif-plugged", "status": "completed", "tag": "db24a0ad-e1d3-43fb-94ed-9469356218c0"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:24.505104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-28e2d88e-fb35-4cbc-8026-ed868069ea20 req-148355da-ce5b-4b74-ac3b-a0557cfd5b70 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:24.505574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-28e2d88e-fb35-4cbc-8026-ed868069ea20 req-148355da-ce5b-4b74-ac3b-a0557cfd5b70 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:24.505997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-28e2d88e-fb35-4cbc-8026-ed868069ea20 req-148355da-ce5b-4b74-ac3b-a0557cfd5b70 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:24.518655 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-28e2d88e-fb35-4cbc-8026-ed868069ea20 req-148355da-ce5b-4b74-ac3b-a0557cfd5b70 service nova] Creating event network-vif-plugged:db24a0ad-e1d3-43fb-94ed-9469356218c0 for instance ae523448-7f85-49ed-8f0b-a6599b05c0cc on hv-cinder-79797 Aug 12 12:29:24.524534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-28e2d88e-fb35-4cbc-8026-ed868069ea20 req-148355da-ce5b-4b74-ac3b-a0557cfd5b70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033707 Aug 12 12:29:24.525835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 700/1373] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:24.678468 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:24.692537 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:24.698859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:24.698859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c33b68ae-7251-4574-8fde-dc31a961197f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.288572 Aug 12 12:29:24.698859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 674/1374] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:24 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:25.420916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:25.422294 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:25.430754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:25.431379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:25.432033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:25.433715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:25.434866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:25.435514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:25.606439 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:25.608985 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:25.617916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ce136842-ae77-447c-a05a-2998cc60887d tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.202579 Aug 12 12:29:25.618724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 701/1375] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:25 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:25.719869 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:25.721094 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:25.729174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:25.729905 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:25.731064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:25.731948 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:25.732550 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:25.733745 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:25.903619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:25.911797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:25.913325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:25.915343 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d9640e0f-213f-4648-8df3-7e1ff9cfdbb6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.199514 Aug 12 12:29:25.915904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 675/1376] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:25 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:26.639186 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:26.640483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:26.647713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:26.648312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:26.649319 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:26.650113 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:26.650561 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:26.650981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:26.822897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:26.831745 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f5e48ae0-7eaa-4035-9c99-d26b9186b23a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1365 microversion: 2.1 time: 0.196310 Aug 12 12:29:26.832511 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 702/1377] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:26 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:26.939660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:26.941042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:26.949362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:26.951067 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:26.951893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:26.952874 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:26.953621 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:26.954810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:27.107175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:27.120219 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:27.122325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:27.123676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d51b2fc2-6f19-47ac-8850-f0453f91fd27 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.189196 Aug 12 12:29:27.124550 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 676/1378] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:26 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:27.853352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:27.853963 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:27.860469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:27.860975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:27.861414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:27.862111 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:27.862569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:27.862999 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:28.011218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:28.020569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-94fb35b6-1094-46e4-a74a-b613e77fb0da tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1554 microversion: 2.1 time: 0.171033 Aug 12 12:29:28.021209 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 703/1379] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:27 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:28.042791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:28.043399 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:28.050233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:28.050820 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:28.051467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:28.053078 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:28.053762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:28.054362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:28.139104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e3fde623-7521-49a2-8537-0c58518c3781 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101088 Aug 12 12:29:28.139700 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 677/1380] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 12 12:29:28 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:28.149869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:28.150493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:28.157373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:28.158065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:28.158663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:28.160259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:28.160757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:28.161205 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:28.324110 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:28.333485 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:28.334991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:28.336805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8eae043d-c5e6-4ff4-b133-c4b28d8c839c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.191815 Aug 12 12:29:28.337451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 704/1381] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:28 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:29.360975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:29.364138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:29.371179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:29.371996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:29.372682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:29.374440 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:29.375857 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:29.376546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:29.479591 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-d889b845-a270-479a-9577-55e0934d88b9 req-175dd859-dfcb-45d2-be4c-9e439d4bce2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae523448-7f85-49ed-8f0b-a6599b05c0cc", "tag": "db24a0ad-e1d3-43fb-94ed-9469356218c0"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:29.502120 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-d889b845-a270-479a-9577-55e0934d88b9 req-175dd859-dfcb-45d2-be4c-9e439d4bce2a service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:29.503746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-d889b845-a270-479a-9577-55e0934d88b9 req-175dd859-dfcb-45d2-be4c-9e439d4bce2a service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:29.503746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-d889b845-a270-479a-9577-55e0934d88b9 req-175dd859-dfcb-45d2-be4c-9e439d4bce2a service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:29.522548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-d889b845-a270-479a-9577-55e0934d88b9 req-175dd859-dfcb-45d2-be4c-9e439d4bce2a service nova] Creating event network-changed:db24a0ad-e1d3-43fb-94ed-9469356218c0 for instance ae523448-7f85-49ed-8f0b-a6599b05c0cc on hv-cinder-79797 Aug 12 12:29:29.533686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-d889b845-a270-479a-9577-55e0934d88b9 req-175dd859-dfcb-45d2-be4c-9e439d4bce2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059684 Aug 12 12:29:29.538403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 705/1382] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:29:29.606336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:29.622038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:29.631203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:29.634005 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d76ac5d6-ceb1-4f92-ad57-9c09a442607f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.277320 Aug 12 12:29:29.638578 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 678/1383] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:29 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:29:30.664401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:30.665197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:30.675151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:30.675664 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:30.676089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:30.676811 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:30.677462 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:30.678050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:30.882030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:30.893470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:30.894997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:30.899908 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1d5738bf-07be-4125-b113-86999c4e9d1c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.236993 Aug 12 12:29:30.900774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 706/1384] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:30 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:31.923615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:31.924202 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:31.930683 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:31.931159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:31.931591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:31.932265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:31.932806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:31.933229 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:32.071709 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:32.079830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:32.081703 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:32.082837 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4d41dada-c748-42b4-b44d-ed4265f23bdd tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.163234 Aug 12 12:29:32.083389 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 679/1385] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:31 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:33.107132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:33.107722 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:33.113989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:33.114462 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:33.114894 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:33.115575 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:33.116061 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:33.116480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:33.246040 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:33.253834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:33.255333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:33.256482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9f060d8e-b85b-45f0-9ea4-6383ef471c69 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1741 microversion: 2.20 time: 0.153437 Aug 12 12:29:33.257074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 707/1386] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:33 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:29:34.279819 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:34.280560 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:34.286864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:34.287346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:34.287782 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:34.288466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:34.289085 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:34.289700 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:34.496018 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:34.504079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:34.505712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:34.506873 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-97dc6029-53b7-4c01-b20e-8517071120a9 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1723 microversion: 2.20 time: 0.230977 Aug 12 12:29:34.507431 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 680/1387] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:34 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:35.535032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:35.535627 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:35.542281 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:35.542829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:35.543253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:35.543937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:35.544376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:35.544824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:35.672018 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:35.679869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:35.681989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:35.683124 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bbf7720f-7f78-430d-ae19-af8103962ada tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1723 microversion: 2.20 time: 0.152298 Aug 12 12:29:35.683686 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 708/1388] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:35 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:36.705696 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:36.706327 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:36.713705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:36.714186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:36.714624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:36.715308 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:36.715760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:36.716188 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:36.848274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:36.856245 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:36.857783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:36.858972 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4c63a1df-44b9-494d-a178-84c455408144 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1723 microversion: 2.20 time: 0.157209 Aug 12 12:29:36.859862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 681/1389] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:36 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:37.882594 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:37.883216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:37.890265 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:37.890735 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:37.891165 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:37.891835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:37.892274 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:37.892715 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:38.018825 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:38.026652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:38.028155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:38.029363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-87fdc6d1-2043-4a8d-945f-f270a57660e1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1666 microversion: 2.20 time: 0.150688 Aug 12 12:29:38.029921 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 709/1390] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:37 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:38.052602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "493297bd-54f9-4531-a037-a40697934b2c"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:38.055072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:38.062475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:38.062895 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:38.063330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:38.064042 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:38.064490 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:38.064942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:38.141268 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:38.277077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-90905342-cd97-4105-b4ad-f743ac56a874 req-44545e0e-b83c-4359-b4e9-6d23f171660f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f15496-02a4-4b9a-838c-16a09258073a", "name": "network-vif-unplugged", "status": "completed", "tag": "49a4b862-501e-4f3a-8a03-2ad524857c12"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:38.286141 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-90905342-cd97-4105-b4ad-f743ac56a874 req-44545e0e-b83c-4359-b4e9-6d23f171660f service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:38.286730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-90905342-cd97-4105-b4ad-f743ac56a874 req-44545e0e-b83c-4359-b4e9-6d23f171660f service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:38.287152 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-90905342-cd97-4105-b4ad-f743ac56a874 req-44545e0e-b83c-4359-b4e9-6d23f171660f service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:38.298445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.compute.server_external_events [req-90905342-cd97-4105-b4ad-f743ac56a874 req-44545e0e-b83c-4359-b4e9-6d23f171660f service nova] Unable to find a host for instance d7f15496-02a4-4b9a-838c-16a09258073a. Dropping event network-vif-unplugged {{(pid=121154) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 12:29:38.299293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-90905342-cd97-4105-b4ad-f743ac56a874 req-44545e0e-b83c-4359-b4e9-6d23f171660f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026740 Aug 12 12:29:38.299855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 710/1391] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 12 12:29:38.937632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:38.938324 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:38.944676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:38.945163 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:38.945593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:38.946273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:38.947207 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:38.947624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:38.972766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Going to try to terminate instance {{(pid=121154) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:29:39.094815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0e3513bb-4a0e-46b4-9cfc-348c918afe6b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.045999 Aug 12 12:29:39.095347 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 682/1392] 10.222.0.27 () {62 vars in 1364 bytes} [Fri Aug 12 12:29:38 2022] POST /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/os-volume_attachments => generated 188 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 12:29:39.225426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:39.225922 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:39.233162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:39.233647 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:39.234078 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:39.234760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:39.235207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:39.235709 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:39.238413 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-1558b9b6-3aeb-4124-8940-bb3c204e450d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 204 len: 0 microversion: 2.1 time: 0.304325 Aug 12 12:29:39.239127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 711/1393] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:29:38 2022] DELETE /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:29:39.248547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:39.249307 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:39.255309 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:39.255794 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:39.256234 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:39.256967 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:39.257427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:39.257857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:39.395691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:39.403579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4c598766-e0a1-42da-84a9-c0a17f428818 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1577 microversion: 2.1 time: 0.159144 Aug 12 12:29:39.404157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 712/1394] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:39 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:39.751447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c9df19b0-a2c5-4f87-a4f1-0a96b8547cd8 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/os-volume_attachments/493297bd-54f9-4531-a037-a40697934b2c" status: 202 len: 0 microversion: 2.20 time: 0.530077 Aug 12 12:29:39.752033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 683/1395] 10.222.0.27 () {60 vars in 1457 bytes} [Fri Aug 12 12:29:39 2022] DELETE /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/os-volume_attachments/493297bd-54f9-4531-a037-a40697934b2c => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 12 12:29:39.812365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:39.813027 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:39.818917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:39.819435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:39.819863 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:39.820540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:39.821013 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:39.821432 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:39.905578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121154) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 12:29:40.154153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0c6c010c-29c6-4586-82c3-96ed97c3c3af tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "POST /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/action" status: 202 len: 0 microversion: 2.20 time: 0.345706 Aug 12 12:29:40.154794 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 713/1396] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Aug 12 12:29:39 2022] POST /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:29:40.163037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:40.163692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:40.171760 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:40.172263 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:40.172712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:40.173411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:40.173861 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:40.174321 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:40.303626 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:40.312433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:40.313975 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:40.315130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e196957f-030b-4d5e-b244-411f2e157b6a tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1674 microversion: 2.20 time: 0.156095 Aug 12 12:29:40.315681 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 684/1397] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:40 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:40.425789 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:40.426461 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:40.433245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:40.433726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:40.434155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:40.434833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:40.435275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:40.435688 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:40.568993 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:40.577484 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e9fb0daf-544c-406f-8868-086817f72dea tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1577 microversion: 2.1 time: 0.155565 Aug 12 12:29:40.583401 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 714/1398] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:40 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:41.338446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:41.339001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:41.345433 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:41.345915 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:41.346356 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:41.347052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:41.347527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:41.347953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:41.559033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:41.567260 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:41.573266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:41.573266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cdf0e9a9-d5bc-4fc4-9845-a113ab39a7b5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1674 microversion: 2.20 time: 0.236017 Aug 12 12:29:41.573266 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 685/1399] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:41 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:41.599470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:41.600086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:41.607151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:41.607639 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:41.608071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:41.608790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:41.609246 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:41.609671 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:41.832229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:41.842171 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-af798357-3e72-4af8-b50d-c01978457782 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1577 microversion: 2.1 time: 0.246573 Aug 12 12:29:41.842755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 715/1400] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:41 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1577 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:42.593922 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:42.599956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:42.601284 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:42.601779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:42.602216 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:42.603637 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:42.604104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:42.604527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:42.840959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-16b42d66-1df7-46a4-93bb-1fc26a70288b req-78105fdf-fb25-4d9d-9eaa-ee8e387bfdfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246a125c-dd37-4c1c-880b-b7ddf37ebd11", "name": "network-vif-deleted", "tag": "54968b04-455b-4d52-ab10-345d319d9a7d"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:29:42.852480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-16b42d66-1df7-46a4-93bb-1fc26a70288b req-78105fdf-fb25-4d9d-9eaa-ee8e387bfdfc service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:42.854296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-16b42d66-1df7-46a4-93bb-1fc26a70288b req-78105fdf-fb25-4d9d-9eaa-ee8e387bfdfc service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:42.854797 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-16b42d66-1df7-46a4-93bb-1fc26a70288b req-78105fdf-fb25-4d9d-9eaa-ee8e387bfdfc service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:42.867277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-16b42d66-1df7-46a4-93bb-1fc26a70288b req-78105fdf-fb25-4d9d-9eaa-ee8e387bfdfc service nova] Creating event network-vif-deleted:54968b04-455b-4d52-ab10-345d319d9a7d for instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 on hv-cinder-79797 Aug 12 12:29:42.872419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-16b42d66-1df7-46a4-93bb-1fc26a70288b req-78105fdf-fb25-4d9d-9eaa-ee8e387bfdfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040272 Aug 12 12:29:42.873102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 716/1401] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:29:42.878086 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:42.878784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:42.888288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:42.888813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:42.889434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:42.890135 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:42.890788 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:42.891057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:43.008160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:43.009464 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:43.012772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:43.018169 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:43.019566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ee599125-3be0-4450-9621-64da264b8a32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1509 microversion: 2.1 time: 0.145308 Aug 12 12:29:43.020073 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:43.020201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 717/1402] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:42 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:43.021414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c308932c-654e-4e11-97bd-859f53301dbc tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.431407 Aug 12 12:29:43.022043 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 686/1403] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:42 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:29:44.064763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:44.065443 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:44.066059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:44.066471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:44.072787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=51 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:44.074881 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:44.075362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:44.075799 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:44.076499 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:44.076979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:44.077402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:44.081652 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:44.091119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:44.091119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:44.091119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:44.091119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:44.091661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:44.123748 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:44.124233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:44.127192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:44.127192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:44.230273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:44.238184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-efa25dfa-7919-4536-a26d-5958d2b16f9c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.177332 Aug 12 12:29:44.238760 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 718/1404] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:44 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:44.270984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:44.280387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:44.281986 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:44.283160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f7a0d38f-b71e-4c75-9ca3-2968ab3b8501 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.222326 Aug 12 12:29:44.283723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 687/1405] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:44 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:45.265188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:45.266511 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:45.272543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:45.273052 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:45.273487 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:45.274180 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:45.274628 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:45.275047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:45.306336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:45.306897 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:45.307617 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:45.307757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:45.308089 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:45.308545 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:45.315392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:45.316120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:45.316667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:45.317427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:45.317953 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:45.318438 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:45.363216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:45.371600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-dc215578-1202-4cec-b912-960f78fcc49e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.111429 Aug 12 12:29:45.372185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 719/1406] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:45 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:45.461488 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:45.469777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:45.471324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:45.472483 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-22faf0a1-751e-4272-afaf-7988a7cbd1fe tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.170060 Aug 12 12:29:45.473265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 688/1407] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:45 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:46.391427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:46.392254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:46.399510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:46.400269 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:46.400831 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:46.401707 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:46.402312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:46.403350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:46.438742 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:46.439486 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:46.440080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:46.440710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:46.489659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:46.495684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:46.496906 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:46.498676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3949f259-db29-4bbd-a896-4b413cd75e8f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.111046 Aug 12 12:29:46.499811 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 720/1408] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:46 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:46.505456 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:46.506311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:46.506962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:46.507698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:46.508151 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:46.508773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:46.644467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:46.652445 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:46.654082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:46.655235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5a75e0f0-879e-4ae3-a19f-ee1013bb20ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.163881 Aug 12 12:29:46.655808 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 689/1409] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:46 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:29:47.519579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:47.520210 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:47.527434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:47.527923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:47.532273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:47.532273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:47.532273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:47.532273 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:47.564355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:47.564869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:47.565303 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:47.565752 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:47.632218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:47.632218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9524f961-9a3d-410e-8742-d7a0bb87e0af tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.104588 Aug 12 12:29:47.632218 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 721/1410] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:47 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:29:47.683788 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:47.684779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:47.694791 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:47.695533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:47.696608 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:47.697511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:47.698072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:47.698674 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:47.847380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:47.857032 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:47.858959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:47.860192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8ee8b168-0005-424c-a709-fe403af6c3a5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.182640 Aug 12 12:29:47.861088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 690/1411] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:47 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:48.644115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:48.645134 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:48.652683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:48.653157 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:48.653592 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:48.654322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:48.654851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:48.655272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:48.687165 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:48.687645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:48.688079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:48.688523 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:48.731376 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:48.739267 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-51a31511-1cfe-4b59-8e61-3173bc73e31f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.099409 Aug 12 12:29:48.739841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 722/1412] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:48 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:48.883375 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:48.883920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:48.891098 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:48.891584 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:48.892024 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:48.893009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:48.893464 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:48.893890 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:49.031223 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:49.039566 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:49.041215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:49.042618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3bab53da-eda3-42e8-8f27-351b67b840de tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.163195 Aug 12 12:29:49.043172 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 691/1413] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:48 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:49.759666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:49.760325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:49.763293 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:49.772132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:49.772751 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:49.773256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:49.774025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:49.774592 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:49.775042 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:49.818186 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:49.818749 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:49.819259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:49.819816 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:49.865896 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:49.874051 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f6631def-a011-4d2d-bcea-7567fb0f4b09 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.118531 Aug 12 12:29:49.874629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 723/1414] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:49 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:50.067015 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:50.067739 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:50.075886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:50.076454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:50.076989 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:50.077754 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:50.078289 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:50.078928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:50.214787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:50.223059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:50.224551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:50.225732 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-66cdf3b4-3211-45de-ac1e-f4f5fabc7602 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.162782 Aug 12 12:29:50.228613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 692/1415] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:50 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:50.895315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:50.895948 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:50.902845 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:50.903357 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:50.903793 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:50.904531 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:50.905025 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:50.905446 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:50.940189 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:50.940724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:50.941122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:50.941568 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:50.984055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:50.991705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ebfa9e70-a260-4d3e-b677-32aba2d3856f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.100436 Aug 12 12:29:50.992277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 724/1416] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:50 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:51.248528 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:51.250483 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:51.258084 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:51.260010 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:51.260010 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:51.260010 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:51.261108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:51.261591 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:51.401826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:51.410580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:51.412348 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:51.413537 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b57e6ae8-166a-4131-84b0-dec0b7ce53ee tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.169665 Aug 12 12:29:51.414411 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 693/1417] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:51 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:52.014591 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:52.015223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:52.021675 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:52.022144 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:52.022615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:52.023272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:52.023692 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:52.024109 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:52.056346 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:52.056908 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:52.057334 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:52.057807 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:52.101158 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:52.109497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-359b64fb-734f-408b-a3b8-73dc45de91b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.100155 Aug 12 12:29:52.110272 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 725/1418] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:52 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:52.437571 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:52.438235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:52.444577 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:52.445090 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:52.445535 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:52.446228 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:52.446683 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:52.447106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:52.589026 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:52.592215 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:52.598944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:52.600509 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:52.601830 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-39b64dd6-0220-451b-b9f4-d6cf23fef607 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.168941 Aug 12 12:29:52.604793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 694/1419] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:52 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:53.131098 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:53.131641 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:53.138039 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:53.138607 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:53.139107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:53.139885 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:53.140524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:53.141056 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:53.173572 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:53.174153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:53.174650 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:53.175161 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:53.222092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:53.229755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-16beb054-90ea-4ea8-9944-9258ea8f7412 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.102765 Aug 12 12:29:53.231389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 726/1420] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:53 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:53.625700 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:53.626304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:53.633347 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:53.633823 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:53.634258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:53.634939 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:53.635392 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:53.635814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:53.769911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:53.779572 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:53.781427 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:53.782829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0de8c123-6215-4c66-b274-f8aea40e635e tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.160975 Aug 12 12:29:53.783498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 695/1421] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:53 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:54.251893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:54.252497 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:54.259033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:54.259508 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:54.259935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:54.260608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:54.261080 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:54.261499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:54.295856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:54.296533 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:54.297200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:54.297839 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:54.340998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:54.348310 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bab0bf15-c40f-4129-be3e-4c3492ab6880 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.100502 Aug 12 12:29:54.348899 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 727/1422] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:54 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:54.805118 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:54.805727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:54.812797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:54.813276 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:54.813706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:54.814388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:54.814835 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:54.815252 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:54.944728 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:54.953207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:54.954744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:54.956311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-faf0bb8c-3e7f-4aa6-a02b-cd2e99c87c86 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.155519 Aug 12 12:29:54.956902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 696/1423] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:54 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:55.369380 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:55.369999 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:55.376947 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:55.377421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:55.377851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:55.378525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:55.378968 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:55.379411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:55.408400 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:55.408964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:55.409390 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:55.409824 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:55.450414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:55.458047 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-943a68ec-a889-45e1-aa45-c8a0dc014ee2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.092625 Aug 12 12:29:55.458603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 728/1424] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:55 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:55.979066 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:55.979672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:55.986624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:55.987106 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:55.987540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:55.988227 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:55.988717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:55.989147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:56.118721 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:56.127260 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:56.128805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:56.129951 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bbdf3c74-a6ec-4884-8b86-fa7f7bc3e8fb tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.154799 Aug 12 12:29:56.130518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 697/1425] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:55 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:56.479154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:56.479757 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:56.486480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:56.486965 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:56.487403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:56.488122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:56.488574 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:56.489026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:56.519629 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:56.520107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:56.520540 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:56.521003 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:56.564905 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:56.572379 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f82d07fe-aea9-4c81-9b41-787c72a8b4d2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.097104 Aug 12 12:29:56.572989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 729/1426] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:56 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:57.151339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:57.151942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:57.158908 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:57.159383 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:57.159810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:57.160512 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:57.160982 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:57.161404 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:57.288531 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:57.297002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:57.298511 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:57.299712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c1074c8f-d60b-4f96-976c-23267247c2d1 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.152323 Aug 12 12:29:57.300275 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 698/1427] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:57 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:57.594260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:57.625843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:57.625843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:57.625843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:57.625843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:57.626322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:57.626322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:57.626322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:57.626322 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:29:57.635998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:57.636472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:57.637029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:57.637500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:57.682108 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:57.690706 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c070ae6e-4827-42bc-a069-05a09cc6a2e4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.100390 Aug 12 12:29:57.691277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 730/1428] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:57 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:58.323114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:58.323800 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:58.330670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:58.331142 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:58.331570 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:58.332246 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:58.332986 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:58.333408 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:58.463727 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:58.472444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:58.473964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:58.475143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-55c7562d-e118-490b-bd42-bec137c634d0 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.156078 Aug 12 12:29:58.475704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 699/1429] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:58 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:58.712079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:58.712758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:58.719453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:58.719925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:58.720358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:58.721066 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:58.721553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:58.721983 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:58.753640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:58.754115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:58.754548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:58.754988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 246a125c-dd37-4c1c-880b-b7ddf37ebd11 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:29:58.795284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:58.802798 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-91403d1c-28c1-44ee-a353-089b27ee1d70 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 200 len: 1230 microversion: 2.1 time: 0.095210 Aug 12 12:29:58.803372 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 731/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:58 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:29:59.498565 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:59.499172 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:59.508889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:59.508889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:59.508889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:59.508889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:59.509264 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:59.509264 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:59.637447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:59.645283 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:59.646773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:29:59.647915 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ae54cc2-d75a-4133-86d6-ae9094cd4c11 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.153913 Aug 12 12:29:59.648465 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 700/1431] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:29:59 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:29:59.823333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:29:59.823951 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:29:59.830445 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:59.830926 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:59.831365 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:59.832053 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:29:59.832805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:29:59.833232 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:29:59.846784 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] HTTP exception thrown: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Request method failure captured: Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 HTTP/1.1 Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kbb5t_HdNw58DciX5gmMeLVVyC7Q7EIFW3eulNSsO8S7BZ0di1-kWZqj_IpQj4KPnjJpGFFMYMtyYha3M-RkPxkgN15KHIYLAiArwHPw4a_icVz0zRAu2cD-CK9noxRVg04knPjXPsfP-dZxP_kK9v-WxbsuOmnNKN5MQ-ojog38DY Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:29:59.848392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_566d2428ccbe41888b9619faf5f212a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}] Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-TestVolumeBootPattern-266125350 Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: a90e3591b4144fdfb8b5ed5391aec7c6 Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:29:59.850155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '246a125c-dd37-4c1c-880b-b7ddf37ebd11'} Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:29:59.851142 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:29:59.852714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:29:59.854104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Returning 404 to user: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:29:59.854104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8c6409ed-5e94-4635-9d8d-e47ebe2072df tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 404 len: 111 microversion: 2.1 time: 0.030405 Aug 12 12:29:59.854104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 732/1432] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:29:59 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:29:59.945255 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-378051869", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1386494864", "security_groups": [{"name": "tempest-secgroup-smoke-1845293560"}], "block_device_mapping_v2": [{"uuid": "f9303369-470e-4728-aa86-6fa93e938af7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "34bda1c6-3fac-4d1d-b2d0-884ebbdd299a"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:30:00.055006 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] validate_networks() for [('34bda1c6-3fac-4d1d-b2d0-884ebbdd299a', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:30:00.461949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:30:00.462369 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:30:00.462838 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:30:00.463242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:30:00.463646 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:30:00.473236 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:00.473717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:00.474151 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:00.474872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:00.475324 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:00.475751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:00.492713 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Getting quotas for project 566d2428ccbe41888b9619faf5f212a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:30:00.499217 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Getting quotas for user a90e3591b4144fdfb8b5ed5391aec7c6 and project 566d2428ccbe41888b9619faf5f212a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:30:00.554763 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:30:00.556897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9303369-470e-4728-aa86-6fa93e938af7',volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:30:00.673874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:00.673874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:00.679955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:00.680557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:00.681120 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:00.682054 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:00.682615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:00.683171 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:00.843946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:00.854632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:00.858325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:00.859586 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e82c592e-93d4-400a-8d20-59259cce4942 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.192922 Aug 12 12:30:00.860332 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 733/1433] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:30:00 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:30:00.981522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bf855a4f-9bbf-4b3c-bc4c-aa56262bc894 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.030822 Aug 12 12:30:00.981522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 701/1434] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:29:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:30:00.984746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f6e864b6-3588-4061-9ba3-9cdebdad4c7f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:00.985450 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f6e864b6-3588-4061-9ba3-9cdebdad4c7f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:01.054140 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f6e864b6-3588-4061-9ba3-9cdebdad4c7f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:01.062665 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f6e864b6-3588-4061-9ba3-9cdebdad4c7f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1094 microversion: 2.1 time: 0.082507 Aug 12 12:30:01.067475 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 734/1435] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:00 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:01.883259 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:01.883868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:01.890262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:01.890744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:01.891174 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:01.891859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:01.892304 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:01.892759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:02.027826 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:02.035037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:02.036567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:02.037740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-888f37ed-49a9-4f09-8857-07616ceb737b tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.158916 Aug 12 12:30:02.038282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 702/1436] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:30:01 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:30:02.083411 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:02.083978 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:02.090125 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:02.090709 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:02.091153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:02.091846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:02.092302 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:02.092754 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:02.154031 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:02.161455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-703e785c-f8df-4260-9021-fa7a9ef59c64 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1136 microversion: 2.1 time: 0.082307 Aug 12 12:30:02.162016 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 735/1437] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:02 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1136 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:02.429587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-79d67ba2-5b0e-4ee6-a393-361f37d38e59 req-f7377883-3eac-4df7-a4af-84dcbf0bf73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f15496-02a4-4b9a-838c-16a09258073a", "name": "network-vif-plugged", "status": "completed", "tag": "49a4b862-501e-4f3a-8a03-2ad524857c12"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:30:02.439244 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-79d67ba2-5b0e-4ee6-a393-361f37d38e59 req-f7377883-3eac-4df7-a4af-84dcbf0bf73d service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:02.439720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-79d67ba2-5b0e-4ee6-a393-361f37d38e59 req-f7377883-3eac-4df7-a4af-84dcbf0bf73d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:02.440147 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-79d67ba2-5b0e-4ee6-a393-361f37d38e59 req-f7377883-3eac-4df7-a4af-84dcbf0bf73d service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:02.451038 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-79d67ba2-5b0e-4ee6-a393-361f37d38e59 req-f7377883-3eac-4df7-a4af-84dcbf0bf73d service nova] Creating event network-vif-plugged:49a4b862-501e-4f3a-8a03-2ad524857c12 for instance d7f15496-02a4-4b9a-838c-16a09258073a on hv-cinder-79797 Aug 12 12:30:02.456100 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-79d67ba2-5b0e-4ee6-a393-361f37d38e59 req-f7377883-3eac-4df7-a4af-84dcbf0bf73d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030300 Aug 12 12:30:02.456701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 703/1438] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:30:03.061908 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:03.062448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:03.068420 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:03.068921 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:03.069356 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:03.070033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:03.070479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:03.070923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:03.184877 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:03.186342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:03.192542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:03.193082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:03.193525 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:03.194220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:03.194676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:03.195222 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:03.217975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:03.226007 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:03.227539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:03.228861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-859bfc6f-745f-47b4-b80f-d264f43f6647 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.172167 Aug 12 12:30:03.229442 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 736/1439] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:30:03 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:30:03.260554 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:03.268567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a70812ad-abdc-49ce-b347-a93db4e327f0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1210 microversion: 2.1 time: 0.089190 Aug 12 12:30:03.269164 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 704/1440] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:03 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:30:04.251557 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:04.252102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:04.258519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:04.260560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:04.260560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:04.260560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:04.260560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:04.261122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:04.293807 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:04.294484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:04.301865 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:04.302376 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:04.306455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:04.306455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:04.306455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:04.306455 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:04.625310 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:04.633458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:04.634975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:04.636132 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-55dae0bb-1ee5-40d3-acaf-75b09ee5d9ed tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.388663 Aug 12 12:30:04.637342 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 737/1441] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:30:04 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:30:04.651556 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:04.662622 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4ea2bba0-8442-446b-84c1-6d49cef0c135 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1278 microversion: 2.1 time: 0.373648 Aug 12 12:30:04.663306 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 705/1442] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:04 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1278 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:05.237969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-62e03eda-3fe5-4c04-8e33-d7e46c2fa72c req-3dd958bc-5cc9-4f2f-8e9a-e9429a4ade78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e558e8-dded-4925-8f10-29a712673bcf", "tag": "5746b817-61d3-408a-b08d-85930765c2e4"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:30:05.249383 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-62e03eda-3fe5-4c04-8e33-d7e46c2fa72c req-3dd958bc-5cc9-4f2f-8e9a-e9429a4ade78 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:05.249868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-62e03eda-3fe5-4c04-8e33-d7e46c2fa72c req-3dd958bc-5cc9-4f2f-8e9a-e9429a4ade78 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:05.250300 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-62e03eda-3fe5-4c04-8e33-d7e46c2fa72c req-3dd958bc-5cc9-4f2f-8e9a-e9429a4ade78 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:05.262969 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-62e03eda-3fe5-4c04-8e33-d7e46c2fa72c req-3dd958bc-5cc9-4f2f-8e9a-e9429a4ade78 service nova] Creating event network-changed:5746b817-61d3-408a-b08d-85930765c2e4 for instance 94e558e8-dded-4925-8f10-29a712673bcf on hv-cinder-79797 Aug 12 12:30:05.267730 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-62e03eda-3fe5-4c04-8e33-d7e46c2fa72c req-3dd958bc-5cc9-4f2f-8e9a-e9429a4ade78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106859 Aug 12 12:30:05.269185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 738/1443] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:30:05.659447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:05.660050 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:05.666514 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:05.668429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:05.668429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:05.668814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:05.669090 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:05.669515 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:05.685137 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:05.687068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:05.704029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:05.704670 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:05.705184 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:05.705976 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:05.706524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:05.707017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:06.317766 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:06.327556 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:06.329486 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-11eaf5b2-40e3-4f17-a93d-7ba8de559762 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.649534 Aug 12 12:30:06.330534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 739/1444] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:05 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:06.337778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:06.339545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:06.344543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-75f7b120-7cae-4d05-a560-5c6a6c4ea072 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1732 microversion: 2.20 time: 0.686070 Aug 12 12:30:06.344543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 706/1445] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:30:05 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1732 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:30:07.352765 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:07.353361 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:07.360284 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:07.360797 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:07.361315 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:07.362008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:07.362458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:07.362882 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:07.366108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:07.366750 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:07.373856 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:07.374335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:07.374765 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:07.375452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:07.375897 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:07.376316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:07.567801 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:07.575603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e757e590-2705-4686-b0fa-7a91c35f2716 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.226636 Aug 12 12:30:07.576444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 740/1446] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:07 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:07.593495 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:07.601453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:07.603269 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:07.604360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dae7bf51-06bd-4d6b-add6-26b916fca1ff tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1719 microversion: 2.20 time: 0.242110 Aug 12 12:30:07.605250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 707/1447] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:30:07 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:30:08.597590 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:08.598191 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:08.609499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:08.609499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:08.609499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:08.609499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:08.609933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:08.609933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:08.737451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:08.744795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4ed26899-7041-4938-a6dc-e2efe2224e5f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.151206 Aug 12 12:30:08.745355 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 741/1448] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:08 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:09.765428 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:09.766028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:09.772573 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:09.773083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:09.773497 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:09.774175 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:09.774615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:09.775033 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:09.908751 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:09.916120 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-29b4f696-cc0d-4f20-9494-4a12cd1c4177 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.154644 Aug 12 12:30:09.916779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 708/1449] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:09 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:10.938029 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:10.938637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:10.945128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:10.945605 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:10.946038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:10.946718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:10.947167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:10.947587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:11.059717 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:11.081473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:11.084259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b45e04e1-49ee-4db8-ae37-1bd1fa8b3228 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.150791 Aug 12 12:30:11.084858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 742/1450] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:10 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:12.104687 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:12.105249 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:12.107793 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:12.108452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:12.114136 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:12.114684 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:12.115126 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:12.115813 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:12.116293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:12.116746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:12.247084 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:12.254462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d8ebb4fa-6fbe-4bc1-9a0b-9b7be6cf20be tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.153725 Aug 12 12:30:12.255053 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 709/1451] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:12 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:13.275353 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:13.275953 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:13.282622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:13.283096 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:13.283528 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:13.284201 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:13.284661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:13.285085 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:13.419902 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:13.427264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2cee9b5a-bbb4-4626-bef7-d339deb8bedf tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.156148 Aug 12 12:30:13.428121 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 743/1452] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:13 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:14.448675 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:14.449288 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:14.451787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:14.456533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:14.457108 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:14.457545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:14.458487 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:14.458949 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:14.459366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:14.593978 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:14.601448 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e365bf19-241c-4298-b2b8-098700150824 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.156635 Aug 12 12:30:14.602009 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 710/1453] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:14 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:15.622785 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:15.623386 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:15.629763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:15.630235 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:15.630664 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:15.631351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:15.631795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:15.632212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:15.764870 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:15.772243 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b746b4e7-ba97-4e6d-95fe-9fec875b182a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.153398 Aug 12 12:30:15.772776 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 744/1454] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:15 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:16.793317 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:16.793915 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:16.800383 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:16.800893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:16.801326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:16.802012 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:16.802458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:16.802878 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:16.934522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:16.942069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4099988f-84c3-4f30-bead-5d75c2f26eb9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.152698 Aug 12 12:30:16.942625 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 711/1455] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:16 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:17.962927 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:17.963458 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:17.970467 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:17.970970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:17.971398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:17.972076 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:17.972515 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:17.972992 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:18.104208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:18.111769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-47dac479-fc4a-4d34-b315-b3c4be4e7be2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.152757 Aug 12 12:30:18.112333 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 745/1456] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:17 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:18.647672 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-cca9c584-31f7-475f-8063-fe395a0e6b7c req-0ec465b4-b3d8-4687-a93f-d9a18a02b075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e558e8-dded-4925-8f10-29a712673bcf", "name": "network-vif-plugged", "status": "completed", "tag": "5746b817-61d3-408a-b08d-85930765c2e4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:30:18.657346 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-cca9c584-31f7-475f-8063-fe395a0e6b7c req-0ec465b4-b3d8-4687-a93f-d9a18a02b075 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:18.657827 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-cca9c584-31f7-475f-8063-fe395a0e6b7c req-0ec465b4-b3d8-4687-a93f-d9a18a02b075 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:18.658291 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-cca9c584-31f7-475f-8063-fe395a0e6b7c req-0ec465b4-b3d8-4687-a93f-d9a18a02b075 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:18.670504 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-cca9c584-31f7-475f-8063-fe395a0e6b7c req-0ec465b4-b3d8-4687-a93f-d9a18a02b075 service nova] Creating event network-vif-plugged:5746b817-61d3-408a-b08d-85930765c2e4 for instance 94e558e8-dded-4925-8f10-29a712673bcf on hv-cinder-79797 Aug 12 12:30:18.675749 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-cca9c584-31f7-475f-8063-fe395a0e6b7c req-0ec465b4-b3d8-4687-a93f-d9a18a02b075 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091815 Aug 12 12:30:18.680681 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 712/1457] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:30:19.132990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:19.133593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:19.140742 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:19.141348 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:19.141880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:19.142713 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:19.143253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:19.143761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:19.272737 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:19.281206 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f8fb317d-6ff2-4807-a4aa-96cb440b72d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.152132 Aug 12 12:30:19.281774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 746/1458] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:19 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:20.302309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:20.303000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:20.310019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:20.310773 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:20.311207 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:20.311884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:20.312330 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:20.312779 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:20.327367 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:20.450124 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:20.457603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-90854aed-29a2-48bc-8143-1864b4155575 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1266 microversion: 2.1 time: 0.159548 Aug 12 12:30:20.458417 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 713/1459] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:20 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:21.479181 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:21.479808 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:21.482935 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=68 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:21.487583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:21.488055 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:21.488483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:21.489270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:21.489714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:21.496436 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:21.621955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:21.629476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9a41e830-a70f-4828-9422-28b6351ef829 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1453 microversion: 2.1 time: 0.154223 Aug 12 12:30:21.630058 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 747/1460] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:21 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:21.649720 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:21.650378 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:21.657810 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:21.658295 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:21.658726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:21.659467 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:21.659914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:21.660332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:21.795580 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:21.803216 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f6739808-321e-4455-b47c-dbd97cd747e8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1453 microversion: 2.1 time: 0.157403 Aug 12 12:30:21.803783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 714/1461] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:21 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:23.429271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:23.429271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:23.431034 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-3617c1ad-8b51-4743-a9ef-a6d395ec1690 req-463241e3-a053-47d9-9a2a-0fceffa803c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5591717-7940-402d-a1b0-737ee67b0743", "tag": "8730add4-d37a-43c9-83e1-97a8314f1259"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:30:23.437217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:23.438611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:23.439271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:23.440285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:23.441032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:23.442123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:23.453043 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-3617c1ad-8b51-4743-a9ef-a6d395ec1690 req-463241e3-a053-47d9-9a2a-0fceffa803c7 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:23.453828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-3617c1ad-8b51-4743-a9ef-a6d395ec1690 req-463241e3-a053-47d9-9a2a-0fceffa803c7 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:23.454440 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-3617c1ad-8b51-4743-a9ef-a6d395ec1690 req-463241e3-a053-47d9-9a2a-0fceffa803c7 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:23.466348 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-3617c1ad-8b51-4743-a9ef-a6d395ec1690 req-463241e3-a053-47d9-9a2a-0fceffa803c7 service nova] Creating event network-changed:8730add4-d37a-43c9-83e1-97a8314f1259 for instance c5591717-7940-402d-a1b0-737ee67b0743 on hv-cinder-79797 Aug 12 12:30:23.472309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-3617c1ad-8b51-4743-a9ef-a6d395ec1690 req-463241e3-a053-47d9-9a2a-0fceffa803c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044774 Aug 12 12:30:23.473607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 715/1462] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:30:23.483326 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Going to try to terminate instance {{(pid=121154) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:30:23.487050 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=100 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:23.709274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-a0dff898-92f8-476f-aaf9-b1c839ded543 req-cace3fa5-2a0e-4666-98e3-7c784796af78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e558e8-dded-4925-8f10-29a712673bcf", "tag": "5746b817-61d3-408a-b08d-85930765c2e4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:30:23.720733 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-a0dff898-92f8-476f-aaf9-b1c839ded543 req-cace3fa5-2a0e-4666-98e3-7c784796af78 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:23.721815 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-a0dff898-92f8-476f-aaf9-b1c839ded543 req-cace3fa5-2a0e-4666-98e3-7c784796af78 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:23.722546 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-a0dff898-92f8-476f-aaf9-b1c839ded543 req-cace3fa5-2a0e-4666-98e3-7c784796af78 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:23.735942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-a0dff898-92f8-476f-aaf9-b1c839ded543 req-cace3fa5-2a0e-4666-98e3-7c784796af78 service nova] Creating event network-changed:5746b817-61d3-408a-b08d-85930765c2e4 for instance 94e558e8-dded-4925-8f10-29a712673bcf on hv-cinder-79797 Aug 12 12:30:23.742233 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-a0dff898-92f8-476f-aaf9-b1c839ded543 req-cace3fa5-2a0e-4666-98e3-7c784796af78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038221 Aug 12 12:30:23.743882 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 716/1463] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:30:23.914853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6e84136f-ef54-42bd-82b4-fb1c99424ebb tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 204 len: 0 microversion: 2.1 time: 0.491825 Aug 12 12:30:23.917026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 748/1464] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:30:23 2022] DELETE /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:30:23.926602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:23.927311 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:23.934918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:23.935413 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:23.935858 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:23.936567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:23.937074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:23.937695 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:24.100265 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:24.109052 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ebc3d71d-8b9a-48ce-a8de-56285dac57d1 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.186585 Aug 12 12:30:24.109937 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 717/1465] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:23 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:25.131995 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:25.132710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:25.139340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:25.139820 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:25.140253 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:25.140965 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:25.141414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:25.141835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:25.686710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:25.694194 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-245ffd92-6996-4385-8d4c-35e9e6fbba54 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1567 microversion: 2.1 time: 0.566565 Aug 12 12:30:25.694913 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 749/1466] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:25 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1567 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:26.599563 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-1d5cad6f-febd-45a1-a1c1-a30edaf07892 req-9bd4e990-9c04-4ede-b278-64efc8fb8c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5591717-7940-402d-a1b0-737ee67b0743", "name": "network-vif-deleted", "tag": "8730add4-d37a-43c9-83e1-97a8314f1259"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:30:26.609946 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1d5cad6f-febd-45a1-a1c1-a30edaf07892 req-9bd4e990-9c04-4ede-b278-64efc8fb8c00 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:26.610446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1d5cad6f-febd-45a1-a1c1-a30edaf07892 req-9bd4e990-9c04-4ede-b278-64efc8fb8c00 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:26.610868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-1d5cad6f-febd-45a1-a1c1-a30edaf07892 req-9bd4e990-9c04-4ede-b278-64efc8fb8c00 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:26.621880 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-1d5cad6f-febd-45a1-a1c1-a30edaf07892 req-9bd4e990-9c04-4ede-b278-64efc8fb8c00 service nova] Creating event network-vif-deleted:8730add4-d37a-43c9-83e1-97a8314f1259 for instance c5591717-7940-402d-a1b0-737ee67b0743 on hv-cinder-79797 Aug 12 12:30:26.626639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-1d5cad6f-febd-45a1-a1c1-a30edaf07892 req-9bd4e990-9c04-4ede-b278-64efc8fb8c00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030802 Aug 12 12:30:26.627209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 718/1467] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:30:26.716151 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:26.716864 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:26.723254 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:26.723738 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:26.724172 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:26.724881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:26.725335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:26.725763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:26.791843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:26.800871 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c3639f32-6290-45cf-b15e-8f8fce4c3300 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1219 microversion: 2.1 time: 0.089163 Aug 12 12:30:26.801768 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 750/1468] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:26 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:27.822769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:27.823463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:27.831738 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:27.832325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:27.832936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:27.834127 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:27.834744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:27.835170 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:27.870285 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:27.871714 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:27.872364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:27.872889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lazy-loading 'fault' on Instance uuid c5591717-7940-402d-a1b0-737ee67b0743 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:30:27.915400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803cf2e2fb664442ae8b0f8919a90aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20b2b17c8794507a7cd8fecfb50e13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:30:27.923388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-66a3d430-61f8-4f43-96e6-0cd9ac46151b tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 200 len: 1224 microversion: 2.1 time: 0.105228 Aug 12 12:30:27.923952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 719/1469] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:27 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:30:28.945392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:28.945999 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] [instance: c5591717-7940-402d-a1b0-737ee67b0743] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:28.953393 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:28.953869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:28.954296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:28.954975 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:28.955420 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:28.955838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:28.970104 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] HTTP exception thrown: Instance c5591717-7940-402d-a1b0-737ee67b0743 could not be found. Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Request method failure captured: Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 HTTP/1.1 Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kZQdxtHwr_Q4_xRuonEpKV6MmwsqEwDY0M0gGEt9tCMxnEMx27LNJ8ZQSEjEvXCDg76OZB54it8Y2-EGGLQ63DnROpjz2QieATzMC3YVD2nSCeIDAGMlIAOL9iw_ePjCnckIhSpnjuN4GbgXRZbKr-Nkasm8jLVIRzOGGsrKPvhiKA Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: b20b2b17c8794507a7cd8fecfb50e13b Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-TestShelveInstance-727935059 Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:30:28.971714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b2b17c8794507a7cd8fecfb50e13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20b2b17c8794507a7cd8fecfb50e13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20b2b17c8794507a7cd8fecfb50e13b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20b2b17c8794507a7cd8fecfb50e13b"}]}] Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-TestShelveInstance-727935059 Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: b20b2b17c8794507a7cd8fecfb50e13b Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-TestShelveInstance-727935059 Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-TestShelveInstance-727935059-project Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 803cf2e2fb664442ae8b0f8919a90aec Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-TestShelveInstance-727935059-project Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance c5591717-7940-402d-a1b0-737ee67b0743 could not be found. Aug 12 12:30:28.973409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'c5591717-7940-402d-a1b0-737ee67b0743'} Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5591717-7940-402d-a1b0-737ee67b0743 could not be found. Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:30:28.974338 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5591717-7940-402d-a1b0-737ee67b0743 could not be found. Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5591717-7940-402d-a1b0-737ee67b0743 could not be found. Aug 12 12:30:28.975940 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:30:28.977312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Returning 404 to user: Instance c5591717-7940-402d-a1b0-737ee67b0743 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:30:28.977312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f54a58df-e264-4d0e-a1d1-7c5d532059c7 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743" status: 404 len: 111 microversion: 2.1 time: 0.031675 Aug 12 12:30:28.977312 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 751/1470] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:30:28 2022] GET /compute/v2.1/servers/c5591717-7940-402d-a1b0-737ee67b0743 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:30:29.221787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8a84a19f-e582-49ea-acbc-05748972cef2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] Calling method '.version_select at 0x7f990e946c10>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:29.314415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8a84a19f-e582-49ea-acbc-05748972cef2 tempest-TestShelveInstance-727935059 tempest-TestShelveInstance-727935059-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-185830658" status: 202 len: 0 microversion: 2.1 time: 0.096451 Aug 12 12:30:29.315003 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 720/1471] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:30:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-185830658 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:30:54.364631 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:54.365250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:54.367299 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:54.367961 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:54.372810 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:54.373290 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:54.373728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:54.374408 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:54.374860 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:54.375332 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:54.398959 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-28750eb6-5df0-4965-9773-2825dca51f88 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/ips" status: 200 len: 145 microversion: 2.1 time: 0.038306 Aug 12 12:30:54.399528 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 752/1472] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:30:54 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:30:56.988952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8de7c8a2-045b-43d7-bf2f-eb9368b7519f"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:30:56.991301 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:56.993864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=29 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:56.994500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:30:57.000828 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:57.001349 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:57.001817 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:57.002540 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:57.002990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:57.003410 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:57.440731 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:30:57.441280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:30:57.448370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:57.448887 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:57.449328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:57.450059 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:30:57.450517 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:30:57.450943 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:30:57.474101 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8bde3b18-ae80-4cc3-8cfc-fed673a99f24 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/ips" status: 200 len: 149 microversion: 2.1 time: 0.038355 Aug 12 12:30:57.474901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 753/1473] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:30:57 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:30:57.865429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cf13e070-8a89-4aef-87d2-23ae4e4f25c2 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880923 Aug 12 12:30:57.866049 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 721/1474] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:30:56 2022] POST /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:00.160128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47d61dba-040e-4481-92cd-a0a1042421b9"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:31:00.162519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:00.170188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:00.170665 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:00.171094 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:00.171772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:00.172217 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:00.172701 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:00.802823 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-cf7ed103-237f-4c9e-b918-4cae2efd0bf1 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "POST /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646619 Aug 12 12:31:00.803848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 754/1475] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:31:00 2022] POST /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:06.444819 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:06.447153 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:06.454339 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:06.454905 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:06.455374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:06.456095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:06.456543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:06.457014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:06.487396 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0b06ae50-d3c0-4925-8c58-45754295abdb tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Aug 12 12:31:06.487956 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 722/1476] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:06 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:06.499637 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:06.500212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:06.506371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:06.506851 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:06.507288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:06.507974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:06.508425 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:06.508876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:06.538612 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8708a5de-10fe-4511-a7b3-8f38c86c0834 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/8de7c8a2-045b-43d7-bf2f-eb9368b7519f" status: 200 len: 194 microversion: 2.1 time: 0.043947 Aug 12 12:31:06.539202 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 755/1477] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Aug 12 12:31:06 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/8de7c8a2-045b-43d7-bf2f-eb9368b7519f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:08.089344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f83e015-2db8-4a6d-9429-2e031f9992e9"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:31:08.091686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:08.099062 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:08.099536 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:08.099965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:08.100667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:08.101112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:08.101537 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:08.739839 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-871037d1-1ae2-434c-b774-3f1fea24272a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "POST /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.654420 Aug 12 12:31:08.740711 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 723/1478] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 12 12:31:08 2022] POST /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:14.643656 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:14.646308 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:14.652608 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:14.653117 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:14.653593 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:14.654288 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:14.654853 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:14.655285 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:14.685983 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-a35c0b1e-941e-40e1-bc2b-c0e7c31b0a60 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046318 Aug 12 12:31:14.686539 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 756/1479] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Aug 12 12:31:14 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:14.777380 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:14.781075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:14.784911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:14.785968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:14.786412 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:14.787167 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:14.787618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:14.788086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:14.817857 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:14.818422 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:14.819335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:31:14.824371 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:14.824891 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:14.825775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:14.826067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:14.826482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:14.826899 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:14.907928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lazy-loading 'services' on Instance uuid ae523448-7f85-49ed-8f0b-a6599b05c0cc {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:31:15.096232 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ae0d64e-3cc9-4bb0-9732-e5213765708d tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 204 len: 0 microversion: 2.20 time: 0.323064 Aug 12 12:31:15.097047 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 724/1480] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Aug 12 12:31:14 2022] DELETE /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 12:31:15.106160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:15.108969 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:15.113075 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:15.113631 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:15.114149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:15.114729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:15.115173 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:15.115629 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:15.158483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c9faacf5-2a15-4afe-86f5-32e106c8f796 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments/47d61dba-040e-4481-92cd-a0a1042421b9" status: 202 len: 0 microversion: 2.1 time: 0.344565 Aug 12 12:31:15.159206 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 757/1481] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:31:14 2022] DELETE /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments/47d61dba-040e-4481-92cd-a0a1042421b9 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 12:31:15.173799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:15.176072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:15.182397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:15.182878 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:15.183320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:15.184008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:15.184451 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:15.184890 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:15.214984 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fd7afbaf-da84-44cf-8d94-a71d58c32993 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049519 Aug 12 12:31:15.215548 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 758/1482] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:15 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:31:15.266512 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:15.275582 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:15.277209 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:15.278454 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8efec372-59fe-454c-ad1a-f9540dce1889 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.176426 Aug 12 12:31:15.279046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 725/1483] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:31:15 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:31:16.227249 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:16.229423 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:16.236011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:16.236493 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:16.236955 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:16.237674 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:16.238123 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:16.238546 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:16.267705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b83cba51-f57b-40bb-bb8b-0de64092f260 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Aug 12 12:31:16.268259 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 759/1484] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:16 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:16.303203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:16.311354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:16.311354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:16.311354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:16.311686 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:16.312293 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:16.312787 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:16.313237 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:16.443980 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:16.452758 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:16.454391 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:16.455608 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a30216a6-cfc7-415a-977b-a5dca95cf3c5 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1725 microversion: 2.20 time: 0.156938 Aug 12 12:31:16.456149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 726/1485] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:31:16 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:31:17.281122 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:17.284660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:17.292654 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:17.293188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:17.293640 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:17.294500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:17.297320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:17.297320 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:17.329958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-17532125-f01a-4054-8667-c11c6325a7ec tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053085 Aug 12 12:31:17.330519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 760/1486] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:17 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:17.481191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:17.481940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:17.490994 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:17.491846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:17.492603 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:17.493836 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:17.494630 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:17.495414 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:17.568072 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:17.577128 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:17.577985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:17.579148 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bd252318-7834-4564-9c4b-ac0fbdfb54df tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1657 microversion: 2.20 time: 0.102864 Aug 12 12:31:17.579719 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 727/1487] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:31:17 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1657 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 12:31:17.727335 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-1f300e42-c5aa-4058-ae98-b726eb72de6d req-c82f8530-6114-4250-b373-bbe6712b58df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f15496-02a4-4b9a-838c-16a09258073a", "name": "network-vif-deleted", "tag": "49a4b862-501e-4f3a-8a03-2ad524857c12"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:31:17.741779 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-1f300e42-c5aa-4058-ae98-b726eb72de6d req-c82f8530-6114-4250-b373-bbe6712b58df service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:17.742325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-1f300e42-c5aa-4058-ae98-b726eb72de6d req-c82f8530-6114-4250-b373-bbe6712b58df service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:17.748710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-1f300e42-c5aa-4058-ae98-b726eb72de6d req-c82f8530-6114-4250-b373-bbe6712b58df service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:17.754665 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-1f300e42-c5aa-4058-ae98-b726eb72de6d req-c82f8530-6114-4250-b373-bbe6712b58df service nova] Creating event network-vif-deleted:49a4b862-501e-4f3a-8a03-2ad524857c12 for instance d7f15496-02a4-4b9a-838c-16a09258073a on hv-cinder-79797 Aug 12 12:31:17.765577 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-1f300e42-c5aa-4058-ae98-b726eb72de6d req-c82f8530-6114-4250-b373-bbe6712b58df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042034 Aug 12 12:31:17.766197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 761/1488] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:18.343447 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:18.345962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:18.352716 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:18.353192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:18.353796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:18.354486 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:18.354933 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:18.355350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:18.386296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3815a8ab-63ef-47d6-909a-3e4f3e19e5e9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Aug 12 12:31:18.386870 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 728/1489] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:18 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:18.608542 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:18.610038 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:18.617547 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:18.618937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:18.618937 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:18.619321 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:18.619874 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:18.620317 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:18.654465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:18.654961 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:18.655435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:18.655899 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lazy-loading 'fault' on Instance uuid d7f15496-02a4-4b9a-838c-16a09258073a {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:31:18.699238 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:18.708758 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:18.710843 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '383cbf83186747a5b81a12ed5288c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84d5684e1904e569a5551b9e21ce0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:18.711999 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bcc63ce2-a1ee-4511-80a2-0343038c80b6 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 200 len: 1371 microversion: 2.20 time: 0.108802 Aug 12 12:31:18.712711 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 762/1490] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:31:18 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 12:31:19.399114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:19.401298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:19.407644 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:19.408118 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:19.408549 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:19.409281 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:19.409729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:19.410149 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:19.438689 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2d4dd6a2-28fa-404b-a392-e76da2dea890 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Aug 12 12:31:19.439276 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 729/1491] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:19 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:19.735398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:19.735997 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:19.742403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:19.742875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:19.743303 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:19.743980 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:19.744421 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:19.744872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:19.759208 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] HTTP exception thrown: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Request method failure captured: Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a HTTP/1.1 Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU5XPnMW9-eALJl7wMyMdczmMW7EVwTbj4feMC4hjWjslI76L-uLmOoaaGBKNW7_MzMzQorf6gat_S56weKjDimpzJ_z5Zo3QWoIZEFmQkz6mefeE4npXetDz29SqhEfRmLRPIP1vvokTTv3AlofE3VEmAsIHLo8Do1HaqmjrqRzAY Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:19.760834 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f84d5684e1904e569a5551b9e21ce0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}] Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 383cbf83186747a5b81a12ed5288c39a Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:19.762677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'd7f15496-02a4-4b9a-838c-16a09258073a'} Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:19.763876 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:19.765603 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:19.767213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Returning 404 to user: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:19.767213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-915f1e46-cfde-4a73-9462-bc67c748ecef tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 404 len: 111 microversion: 2.20 time: 0.030706 Aug 12 12:31:19.767213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 763/1492] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:31:19 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 12:31:19.771607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ebffef05-0bfb-44d3-b2e6-16da63b4af28 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '.version_select at 0x7f990e9729d0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:19.828415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ebffef05-0bfb-44d3-b2e6-16da63b4af28 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-831904114" status: 204 len: 0 microversion: 2.20 time: 0.061242 Aug 12 12:31:19.829129 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 730/1493] 10.222.0.27 () {60 vars in 1259 bytes} [Fri Aug 12 12:31:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-831904114 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 12:31:20.450930 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:20.453229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:20.460778 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:20.464381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:20.464381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:20.464381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:20.464381 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:20.464903 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:20.512174 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ad191fc8-1f4a-4ee3-865b-e938ee29a654 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065304 Aug 12 12:31:20.513366 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 764/1494] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:20 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:21.525014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:21.527290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:21.534660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:21.535166 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:21.535637 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:21.537084 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:21.537587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:21.538044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:21.568512 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b88fae8c-6d48-4aa3-b2d2-3bc113df025f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048818 Aug 12 12:31:21.569441 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 731/1495] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:21 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:21.885023 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:21.885551 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:21.891799 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:21.892275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:21.892736 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:21.893419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:21.893866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:21.894291 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:21.908153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] HTTP exception thrown: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Request method failure captured: Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a HTTP/1.1 Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU5XPnMW9-eALJl7wMyMdczmMW7EVwTbj4feMC4hjWjslI76L-uLmOoaaGBKNW7_MzMzQorf6gat_S56weKjDimpzJ_z5Zo3QWoIZEFmQkz6mefeE4npXetDz29SqhEfRmLRPIP1vvokTTv3AlofE3VEmAsIHLo8Do1HaqmjrqRzAY Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:21.909720 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f84d5684e1904e569a5551b9e21ce0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}] Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 383cbf83186747a5b81a12ed5288c39a Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.911341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'd7f15496-02a4-4b9a-838c-16a09258073a'} Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:21.912233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.913725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.915330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Returning 404 to user: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:21.915330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-4988000a-cf97-46c3-b84e-a44190a6e78c tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 404 len: 111 microversion: 2.20 time: 0.029918 Aug 12 12:31:21.915330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 765/1496] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Aug 12 12:31:21 2022] DELETE /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 12:31:21.919478 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:21.920083 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: d7f15496-02a4-4b9a-838c-16a09258073a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:21.926027 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:21.926506 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:21.926945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:21.927707 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:21.928160 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:21.928588 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:21.941567 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] HTTP exception thrown: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Request method failure captured: Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a HTTP/1.1 Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU5XPnMW9-eALJl7wMyMdczmMW7EVwTbj4feMC4hjWjslI76L-uLmOoaaGBKNW7_MzMzQorf6gat_S56weKjDimpzJ_z5Zo3QWoIZEFmQkz6mefeE4npXetDz29SqhEfRmLRPIP1vvokTTv3AlofE3VEmAsIHLo8Do1HaqmjrqRzAY Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:21.943692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f84d5684e1904e569a5551b9e21ce0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}] Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 383cbf83186747a5b81a12ed5288c39a Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.945395 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'd7f15496-02a4-4b9a-838c-16a09258073a'} Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:21.946313 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. Aug 12 12:31:21.947852 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:21.949152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Returning 404 to user: Instance d7f15496-02a4-4b9a-838c-16a09258073a could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:21.949152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5f9299b4-fe01-46db-8443-bdad97a83d4f tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a" status: 404 len: 111 microversion: 2.20 time: 0.029429 Aug 12 12:31:21.949152 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 732/1497] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:31:21 2022] GET /compute/v2.1/servers/d7f15496-02a4-4b9a-838c-16a09258073a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 12:31:22.580964 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:22.583352 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:22.590580 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:22.591063 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:22.591494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:22.592182 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:22.592624 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:22.593072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:22.619822 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:22.622112 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:22.623026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8f9cf053-d3ac-4639-be3b-6e2903edd96a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046102 Aug 12 12:31:22.623747 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 766/1498] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:22 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:22.628894 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:22.629402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:22.630491 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:22.635666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:22.635666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:22.635666 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:22.665593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b08de37e-189d-4503-be03-2c2e3ae8e1c4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049898 Aug 12 12:31:22.666197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 733/1499] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:22 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:31:22.810023 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:22.810494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:22.816535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:22.817048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:22.817657 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:22.818361 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:22.818807 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:22.820426 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:22.849587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c7fce0d4-2175-4bbb-a295-791e77d196ad tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/8de7c8a2-045b-43d7-bf2f-eb9368b7519f" status: 200 len: 194 microversion: 2.1 time: 0.043715 Aug 12 12:31:22.850188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 767/1500] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Aug 12 12:31:22 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/8de7c8a2-045b-43d7-bf2f-eb9368b7519f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:22.860792 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:22.861274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:22.867977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:22.868449 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:22.870913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:22.870913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:22.870913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:22.870913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:22.946610 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:31:22.950320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lazy-loading 'services' on Instance uuid a728a3db-f9b1-4ec6-8902-db5dca83f5e7 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:31:23.176198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9b1f5d19-cde7-424f-93c0-df49c99f508d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/8de7c8a2-045b-43d7-bf2f-eb9368b7519f" status: 202 len: 0 microversion: 2.1 time: 0.319210 Aug 12 12:31:23.177158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 734/1501] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:31:22 2022] DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/8de7c8a2-045b-43d7-bf2f-eb9368b7519f => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:31:23.241727 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:23.242216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:23.248634 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:23.250595 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:23.250595 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:23.250595 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:23.250933 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:23.251071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:23.264112 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] HTTP exception thrown: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Request method failure captured: Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 HTTP/1.1 Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU5XPnMW9-eALJl7wMyMdczmMW7EVwTbj4feMC4hjWjslI76L-uLmOoaaGBKNW7_MzMzQorf6gat_S56weKjDimpzJ_z5Zo3QWoIZEFmQkz6mefeE4npXetDz29SqhEfRmLRPIP1vvokTTv3AlofE3VEmAsIHLo8Do1HaqmjrqRzAY Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:23.265669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f84d5684e1904e569a5551b9e21ce0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}] Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 383cbf83186747a5b81a12ed5288c39a Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.267325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '87e50626-b455-4357-8ab1-4ed9dea35297'} Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:23.268337 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.269881 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.272225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Returning 404 to user: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:23.272225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-2791277a-5b56-41d6-8fe9-f70cdb837596 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 404 len: 111 microversion: 2.20 time: 0.029367 Aug 12 12:31:23.272225 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 768/1502] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Aug 12 12:31:23 2022] DELETE /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 12:31:23.278551 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:23.279252 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] [instance: 87e50626-b455-4357-8ab1-4ed9dea35297] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:23.285777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:23.286859 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:23.287290 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:23.287967 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:23.288463 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:23.288932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:23.303093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] HTTP exception thrown: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Request method failure captured: Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 HTTP/1.1 Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU5XPnMW9-eALJl7wMyMdczmMW7EVwTbj4feMC4hjWjslI76L-uLmOoaaGBKNW7_MzMzQorf6gat_S56weKjDimpzJ_z5Zo3QWoIZEFmQkz6mefeE4npXetDz29SqhEfRmLRPIP1vvokTTv3AlofE3VEmAsIHLo8Do1HaqmjrqRzAY Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:23.304759 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f84d5684e1904e569a5551b9e21ce0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f84d5684e1904e569a5551b9e21ce0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f84d5684e1904e569a5551b9e21ce0ff"}]}] Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: f84d5684e1904e569a5551b9e21ce0ff Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053795555 Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 383cbf83186747a5b81a12ed5288c39a Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053795555-project Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.306510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '87e50626-b455-4357-8ab1-4ed9dea35297'} Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:23.307400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. Aug 12 12:31:23.308896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:23.310483 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] Returning 404 to user: Instance 87e50626-b455-4357-8ab1-4ed9dea35297 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:23.310483 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d496f45b-c73c-48c1-aa5b-d90bb9f60533 tempest-AttachVolumeShelveTestJSON-2053795555 tempest-AttachVolumeShelveTestJSON-2053795555-project] 10.222.0.27 "GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297" status: 404 len: 111 microversion: 2.20 time: 0.032338 Aug 12 12:31:23.310483 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 735/1503] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 12 12:31:23 2022] GET /compute/v2.1/servers/87e50626-b455-4357-8ab1-4ed9dea35297 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 12:31:23.635452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:23.637648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:23.643553 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:23.644037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:23.644473 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:23.645195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:23.645931 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:23.646359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:23.663772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:31:23.675905 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bdd4530e-76ec-48a6-91ff-a9e6ff10863e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044519 Aug 12 12:31:23.676996 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 769/1504] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:23 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:31:23.739121 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:23.740185 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:23.746662 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:23.747199 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:23.747639 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:23.748323 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:23.748797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:23.749220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:23.774718 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:31:24.067350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dfd08a15-078b-4b28-aa9a-c4186812deb3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 204 len: 0 microversion: 2.1 time: 0.332222 Aug 12 12:31:24.068002 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 736/1505] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:31:23 2022] DELETE /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:31:24.076525 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:24.083635 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:24.085283 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:24.085802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:24.086264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:24.086994 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:24.087480 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:24.087923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:24.294875 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:24.302611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-46f6fb54-836d-476b-9407-df4f214ed8c3 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1679 microversion: 2.1 time: 0.230252 Aug 12 12:31:24.303185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 770/1506] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:24 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:25.328529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:25.328529 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:25.338966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:25.339746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:25.340402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:25.341345 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:25.342196 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:25.343158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:25.369448 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:25.369998 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:25.376512 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:25.377266 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:25.377868 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:25.378726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:25.379378 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:25.379996 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:25.439721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-3307b4c4-053e-4d86-bc4e-45181309dbcf tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/7f83e015-2db8-4a6d-9429-2e031f9992e9" status: 200 len: 194 microversion: 2.1 time: 0.074283 Aug 12 12:31:25.440336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 771/1507] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Aug 12 12:31:25 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/7f83e015-2db8-4a6d-9429-2e031f9992e9 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:31:25.453148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:25.460245 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:25.467920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:25.468405 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:25.468858 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:25.469734 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:25.470340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:25.470916 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:25.519673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:25.528024 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ef84c5cb-7067-4d19-83f1-cc383dd6c874 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1679 microversion: 2.1 time: 0.208295 Aug 12 12:31:25.528854 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 737/1508] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:25 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:25.576416 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lazy-loading 'services' on Instance uuid a728a3db-f9b1-4ec6-8902-db5dca83f5e7 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:31:25.802566 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7c87fae1-dfb6-4e84-a036-fba04ceede9f tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/7f83e015-2db8-4a6d-9429-2e031f9992e9" status: 202 len: 0 microversion: 2.1 time: 0.352989 Aug 12 12:31:25.805366 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 772/1509] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 12 12:31:25 2022] DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments/7f83e015-2db8-4a6d-9429-2e031f9992e9 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:31:26.553722 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:26.555010 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:26.561562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:26.562364 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:26.563014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:26.563934 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:26.564619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:26.565182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:27.120500 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:27.127998 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8b0e44f0-3677-4948-9cab-0ba1c913660a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1679 microversion: 2.1 time: 0.582501 Aug 12 12:31:27.144407 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 738/1510] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:26 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1679 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:28.053984 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:28.056534 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:28.062814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.063295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.063772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.064698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.065160 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.065576 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.099227 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-beb8491f-ef67-43c7-ad0c-4d037b57751b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049846 Aug 12 12:31:28.099804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 773/1511] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:28 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 12:31:28.180410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-3a1b9e46-959d-4178-9d18-3b2d30451b0e req-d3acadb8-e224-43d2-91ee-b7973fe00714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae523448-7f85-49ed-8f0b-a6599b05c0cc", "name": "network-vif-deleted", "tag": "db24a0ad-e1d3-43fb-94ed-9469356218c0"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:31:28.188450 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:28.189122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:28.191601 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-3a1b9e46-959d-4178-9d18-3b2d30451b0e req-d3acadb8-e224-43d2-91ee-b7973fe00714 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.191962 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:31:28.192260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-3a1b9e46-959d-4178-9d18-3b2d30451b0e req-d3acadb8-e224-43d2-91ee-b7973fe00714 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.192761 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-3a1b9e46-959d-4178-9d18-3b2d30451b0e req-d3acadb8-e224-43d2-91ee-b7973fe00714 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.198336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.198824 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.199267 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.199965 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.200419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.200872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.208819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-3a1b9e46-959d-4178-9d18-3b2d30451b0e req-d3acadb8-e224-43d2-91ee-b7973fe00714 service nova] Creating event network-vif-deleted:db24a0ad-e1d3-43fb-94ed-9469356218c0 for instance ae523448-7f85-49ed-8f0b-a6599b05c0cc on hv-cinder-79797 Aug 12 12:31:28.214812 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-3a1b9e46-959d-4178-9d18-3b2d30451b0e req-d3acadb8-e224-43d2-91ee-b7973fe00714 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042545 Aug 12 12:31:28.220685 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 774/1512] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:28.273829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:28.275216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:28.289065 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.293270 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.293836 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.295071 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.295600 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.297177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.320661 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:28.330019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9b3609ff-ca7c-438d-804d-5622049c3585 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1612 microversion: 2.1 time: 0.180799 Aug 12 12:31:28.330979 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 739/1513] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:28 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1612 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:28.382410 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-fa8a2c1e-606d-402b-bada-d450bf39cae9 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116105 Aug 12 12:31:28.383295 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 775/1514] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 12 12:31:28 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 12:31:28.471191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:28.471856 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:28.479184 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.479742 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.480241 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.481031 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.481545 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.482637 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.508243 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:31:28.855862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2dd77fc8-336d-45a9-b2dd-3f3a6415cde5 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 204 len: 0 microversion: 2.1 time: 0.397525 Aug 12 12:31:28.856446 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 740/1515] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:31:28 2022] DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:31:28.864541 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:28.865373 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:28.871366 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.871848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.872278 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:28.872984 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:28.873428 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:28.873884 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:29.022949 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:29.031286 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9be4fe38-08ef-425b-a342-d9ae4e372186 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1672 microversion: 2.1 time: 0.170513 Aug 12 12:31:29.032377 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 776/1516] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:28 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:29.357614 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:29.359934 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:29.366118 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:29.366682 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:29.367187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:29.367961 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:29.368491 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:29.369025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:29.402441 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:29.402959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:29.403483 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:29.403898 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lazy-loading 'fault' on Instance uuid ae523448-7f85-49ed-8f0b-a6599b05c0cc {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:31:29.448670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:29.456151 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f07a8881-7409-49d3-aaee-8f0edab83ee9 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1330 microversion: 2.1 time: 0.102748 Aug 12 12:31:29.456920 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 741/1517] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:29 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:30.053718 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:30.054412 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:30.060798 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:30.061354 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:30.061859 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:30.062615 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:30.063136 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:30.063628 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:30.204838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:30.213838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-60fcfbce-ab44-48e1-9bc4-8277d8ca3219 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1672 microversion: 2.1 time: 0.164391 Aug 12 12:31:30.217848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 777/1518] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:30 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:30.477917 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:30.478358 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:30.484802 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:30.485280 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:30.485716 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:30.486400 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:30.486848 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:30.487272 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:30.520834 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:30.521498 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:30.521958 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:30.522452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lazy-loading 'fault' on Instance uuid ae523448-7f85-49ed-8f0b-a6599b05c0cc {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:31:30.563917 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0156c689e109489d9265dd3dd4d5cfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d79773c49d643fc8eb04d69aafb0b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:30.571517 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9c2599c3-eb29-480b-a42d-297bd8517b9f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 200 len: 1330 microversion: 2.1 time: 0.098083 Aug 12 12:31:30.572090 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 742/1519] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:30 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:31.237256 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:31.237808 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:31.241115 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=55 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:31:31.248532 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:31.249048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:31.249484 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:31.250175 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:31.250622 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:31.251041 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:31.508289 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:31.515982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8bd5456f-6bd9-4a04-9b84-9348963dcb6b tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1672 microversion: 2.1 time: 0.282592 Aug 12 12:31:31.516786 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 778/1520] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:31 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1672 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:31:31.593884 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:31.594519 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:31.601692 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:31.607538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:31.607538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:31.607538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:31.607538 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:31.608103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:31.618508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc HTTP/1.1 Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:31.620177 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:31.621970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'ae523448-7f85-49ed-8f0b-a6599b05c0cc'} Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:31.626688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:31.628303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:31.630543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:31.630543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-265f29ae-79d2-46d9-b85d-a6ccf4f861ef tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 404 len: 111 microversion: 2.1 time: 0.031705 Aug 12 12:31:31.630543 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 743/1521] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:31 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:31.631316 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7706b98c-102c-443a-909e-ec5167b60a3f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '.version_select at 0x7f99176e8670>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:31.714666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7706b98c-102c-443a-909e-ec5167b60a3f tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-763545851" status: 202 len: 0 microversion: 2.1 time: 0.087656 Aug 12 12:31:31.715370 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 779/1522] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Aug 12 12:31:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-763545851 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 12:31:32.540039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:32.541001 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:32.554782 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:32.555419 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:32.555864 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:32.557348 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:32.558081 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:32.560039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:32.696053 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:32.708059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ed960960-3fc9-434e-8dbf-5201bc6ed03c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1605 microversion: 2.1 time: 0.171796 Aug 12 12:31:32.708059 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 744/1523] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:32 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1605 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:32.739928 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-ebe13a37-f024-4c66-94e1-0f763c44cc62 req-e3e20b1c-f228-4342-b7ee-41e01d2dadaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a728a3db-f9b1-4ec6-8902-db5dca83f5e7", "name": "network-vif-deleted", "tag": "03bba527-b569-45bb-b10f-6d96e751596f"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:31:32.757960 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ebe13a37-f024-4c66-94e1-0f763c44cc62 req-e3e20b1c-f228-4342-b7ee-41e01d2dadaf service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:32.758645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ebe13a37-f024-4c66-94e1-0f763c44cc62 req-e3e20b1c-f228-4342-b7ee-41e01d2dadaf service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:32.759902 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-ebe13a37-f024-4c66-94e1-0f763c44cc62 req-e3e20b1c-f228-4342-b7ee-41e01d2dadaf service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:32.772299 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-ebe13a37-f024-4c66-94e1-0f763c44cc62 req-e3e20b1c-f228-4342-b7ee-41e01d2dadaf service nova] Creating event network-vif-deleted:03bba527-b569-45bb-b10f-6d96e751596f for instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 on hv-cinder-79797 Aug 12 12:31:32.779804 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-ebe13a37-f024-4c66-94e1-0f763c44cc62 req-e3e20b1c-f228-4342-b7ee-41e01d2dadaf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046608 Aug 12 12:31:32.781163 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 780/1524] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:33.728999 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:33.729612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:33.735959 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:33.736676 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:33.737114 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:33.737985 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:33.738660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:33.739976 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:33.772964 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:33.773541 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:33.774045 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:33.774557 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lazy-loading 'fault' on Instance uuid a728a3db-f9b1-4ec6-8902-db5dca83f5e7 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:31:33.821378 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f9fac4e1de488b9964f988d238483a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbadb872e74c57813900e5ebb6ac88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:31:33.829312 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-340f4164-0679-4baa-becc-12f30d322070 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 200 len: 1327 microversion: 2.1 time: 0.104151 Aug 12 12:31:33.831103 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 745/1525] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:33 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:31:34.195659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:34.196438 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:34.202543 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:34.203095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:34.203597 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:34.204449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:34.204941 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:34.205368 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:34.218753 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc HTTP/1.1 Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:34.220389 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.222048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'ae523448-7f85-49ed-8f0b-a6599b05c0cc'} Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:34.222981 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.225392 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.226847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:34.226847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e541b6cc-ed24-47b3-a5d9-127b1f7a575a tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 404 len: 111 microversion: 2.1 time: 0.032006 Aug 12 12:31:34.226847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 781/1526] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:31:34 2022] DELETE /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:34.231070 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:34.231694 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: ae523448-7f85-49ed-8f0b-a6599b05c0cc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:34.237667 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:34.238143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:34.238569 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:34.239913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:34.240362 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:34.240805 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:34.256354 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc HTTP/1.1 Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:34.257868 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.259611 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'ae523448-7f85-49ed-8f0b-a6599b05c0cc'} Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:34.260505 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. Aug 12 12:31:34.262039 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.263393 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance ae523448-7f85-49ed-8f0b-a6599b05c0cc could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:34.263393 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-878d3f94-1aea-4900-8099-a3a0f4745690 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc" status: 404 len: 111 microversion: 2.1 time: 0.032265 Aug 12 12:31:34.263393 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 746/1527] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:34 2022] GET /compute/v2.1/servers/ae523448-7f85-49ed-8f0b-a6599b05c0cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:34.850840 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:34.851579 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:34.857725 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:34.858195 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:34.858697 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:34.859372 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:34.859819 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:34.860283 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:34.878549 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] HTTP exception thrown: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Request method failure captured: Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 HTTP/1.1 Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kXAjg8lZU09N3kQqF9hd8yfT4dMy8G8653xyi8KHyQHUUUCeGV2VdI22C3CSXaxnstY53iVVWhXxSLyT_o9_0qdta1icNZe4o-Zp8oB1JDKc_N47o59AFt0AW807XM_-ggFc_cCr_dWPJhNUHwxVUviDgSN9FD68EOBipD3qyZ1z6U Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:34.880068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0fbadb872e74c57813900e5ebb6ac88", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}] Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: d3f9fac4e1de488b9964f988d238483a Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:34.881535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'a728a3db-f9b1-4ec6-8902-db5dca83f5e7'} Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:34.882522 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:34.883829 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:34.885427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Returning 404 to user: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:34.885427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-96d0aa00-83d8-40c2-81c3-2015e3d134a4 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 404 len: 111 microversion: 2.1 time: 0.036899 Aug 12 12:31:34.885427 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 782/1528] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:34 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:34.892294 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-befd02a2-93a2-476a-9bed-51a6c341beae tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '.version_select at 0x7f9914133d30>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:34.966022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-befd02a2-93a2-476a-9bed-51a6c341beae tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385400484" status: 202 len: 0 microversion: 2.1 time: 0.077909 Aug 12 12:31:34.966612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 747/1529] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 12 12:31:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385400484 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:31:35.581347 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:35.581970 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:35.590197 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:35.590771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:35.591305 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:35.592102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:35.592691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:35.593220 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:35.609260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 HTTP/1.1 Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:35.610982 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.612669 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '16ebc13e-bbe5-467e-9a7f-d58a333c5b09'} Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:35.613636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.615813 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.617314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:35.617314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-80feac37-a768-4695-8e82-d879610e4861 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 404 len: 111 microversion: 2.1 time: 0.040209 Aug 12 12:31:35.617314 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 783/1530] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:31:35 2022] DELETE /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:35.621902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:35.622521 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: 16ebc13e-bbe5-467e-9a7f-d58a333c5b09] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:35.629325 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:35.630064 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:35.630518 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:35.631247 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:35.631797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:35.632138 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:35.646344 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 HTTP/1.1 Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:35.647936 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.649616 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '16ebc13e-bbe5-467e-9a7f-d58a333c5b09'} Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:35.650458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. Aug 12 12:31:35.651762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.653171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance 16ebc13e-bbe5-467e-9a7f-d58a333c5b09 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:35.653171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9c080692-f8f6-43c5-8302-572593a01e29 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09" status: 404 len: 111 microversion: 2.1 time: 0.031444 Aug 12 12:31:35.653171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 748/1531] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:35 2022] GET /compute/v2.1/servers/16ebc13e-bbe5-467e-9a7f-d58a333c5b09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:35.658555 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:35.659125 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:35.667856 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:35.668351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:35.668849 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:35.669558 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:35.670008 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:35.670482 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:35.685535 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 HTTP/1.1 Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:35.687127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.689037 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'cb10d887-ad82-4cbc-a00f-5fe01c3150b6'} Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:35.693026 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.694724 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.696219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:35.696219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-bc1e801a-4f14-4627-b048-5c2458db9e5c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 404 len: 111 microversion: 2.1 time: 0.033886 Aug 12 12:31:35.696219 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 784/1532] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:31:35 2022] DELETE /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:35.698171 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:35.698789 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: cb10d887-ad82-4cbc-a00f-5fe01c3150b6] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:35.705413 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:35.705931 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:35.706374 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:35.707069 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:35.709088 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:35.709542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:35.724712 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 HTTP/1.1 Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:35.726256 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.727952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'cb10d887-ad82-4cbc-a00f-5fe01c3150b6'} Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:35.728809 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. Aug 12 12:31:35.730102 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:35.731220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance cb10d887-ad82-4cbc-a00f-5fe01c3150b6 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:35.731220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-514c989f-cbfd-46f3-be91-412858a9763c tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6" status: 404 len: 111 microversion: 2.1 time: 0.034057 Aug 12 12:31:35.731220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 749/1533] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:35 2022] GET /compute/v2.1/servers/cb10d887-ad82-4cbc-a00f-5fe01c3150b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:36.983528 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:36.984032 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:36.996073 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:36.996848 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:36.997454 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:36.998154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:36.998610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:36.999048 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:37.014277 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 HTTP/1.1 Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:37.015814 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.017527 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'eb0081c4-5cc9-45f7-b6bb-558b73793525'} Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:37.018611 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.020192 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.023499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:37.023499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-b6373b7f-784e-407c-89ae-478c5cb79d06 tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 404 len: 111 microversion: 2.1 time: 0.038746 Aug 12 12:31:37.023499 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 785/1534] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:31:36 2022] DELETE /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:37.025937 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:37.026542 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] [instance: eb0081c4-5cc9-45f7-b6bb-558b73793525] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:37.033013 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:37.033494 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:37.033933 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:37.034615 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:37.035065 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:37.035520 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:37.049225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] HTTP exception thrown: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Request method failure captured: Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 HTTP/1.1 Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kU4tGqQaN30p7C1yUteIVnybYGJwcUCUZHKlUwFkb1QiVyXLIqYlXG2ceRPucsna_wfA95eXw9EFC5BInmv5xnD-Z0AdTZ7KEKs0mr2ObHU7dKMWlIm8sgmVgooYm9jTIpxl-65nwasTFro4OqG1uGReta70Eg82vpX2ImsFUFC7zc Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:37.050735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d79773c49d643fc8eb04d69aafb0b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d79773c49d643fc8eb04d69aafb0b01", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d79773c49d643fc8eb04d69aafb0b01"}]}] Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3d79773c49d643fc8eb04d69aafb0b01 Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164887061 Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: 0156c689e109489d9265dd3dd4d5cfde Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-164887061-project Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.052889 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'eb0081c4-5cc9-45f7-b6bb-558b73793525'} Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:37.053757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. Aug 12 12:31:37.054977 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:37.056087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] Returning 404 to user: Instance eb0081c4-5cc9-45f7-b6bb-558b73793525 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:37.056087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8b3a9586-48f4-45f1-9a7f-c1e2e364832e tempest-AttachVolumeNegativeTest-164887061 tempest-AttachVolumeNegativeTest-164887061-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525" status: 404 len: 111 microversion: 2.1 time: 0.030698 Aug 12 12:31:37.056087 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 750/1535] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:37 2022] GET /compute/v2.1/servers/eb0081c4-5cc9-45f7-b6bb-558b73793525 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:38.430770 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:38.468714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:38.468714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:38.468714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:38.468714 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:38.469483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:38.469483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:38.469483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:38.469483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] HTTP exception thrown: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.469483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Request method failure captured: Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 HTTP/1.1 Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kXAjg8lZU09N3kQqF9hd8yfT4dMy8G8653xyi8KHyQHUUUCeGV2VdI22C3CSXaxnstY53iVVWhXxSLyT_o9_0qdta1icNZe4o-Zp8oB1JDKc_N47o59AFt0AW807XM_-ggFc_cCr_dWPJhNUHwxVUviDgSN9FD68EOBipD3qyZ1z6U Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:38.469852 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0fbadb872e74c57813900e5ebb6ac88", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}] Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: d3f9fac4e1de488b9964f988d238483a Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.471072 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'a728a3db-f9b1-4ec6-8902-db5dca83f5e7'} Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:38.471872 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.473677 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.475419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Returning 404 to user: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:38.475419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c6c66178-5e0d-48de-8fa6-12cef540677c tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 404 len: 111 microversion: 2.1 time: 0.038043 Aug 12 12:31:38.475419 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 786/1536] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:31:38 2022] DELETE /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:31:38.475640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:38.475640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: a728a3db-f9b1-4ec6-8902-db5dca83f5e7] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:38.483186 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:38.483688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:38.484132 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:38.484918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:38.485568 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:38.486024 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:38.503918 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] HTTP exception thrown: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Request method failure captured: Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 HTTP/1.1 Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kXAjg8lZU09N3kQqF9hd8yfT4dMy8G8653xyi8KHyQHUUUCeGV2VdI22C3CSXaxnstY53iVVWhXxSLyT_o9_0qdta1icNZe4o-Zp8oB1JDKc_N47o59AFt0AW807XM_-ggFc_cCr_dWPJhNUHwxVUviDgSN9FD68EOBipD3qyZ1z6U Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:38.506014 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0fbadb872e74c57813900e5ebb6ac88", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}] Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: d3f9fac4e1de488b9964f988d238483a Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.507612 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'a728a3db-f9b1-4ec6-8902-db5dca83f5e7'} Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:38.508368 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. Aug 12 12:31:38.513182 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:38.514360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Returning 404 to user: Instance a728a3db-f9b1-4ec6-8902-db5dca83f5e7 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:38.514360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dea7ab30-727a-4d6d-bedd-27f4beb9c347 tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7" status: 404 len: 111 microversion: 2.1 time: 0.037987 Aug 12 12:31:38.514360 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 751/1537] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:38 2022] GET /compute/v2.1/servers/a728a3db-f9b1-4ec6-8902-db5dca83f5e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:39.828661 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:39.829228 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:39.836802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:39.844035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:39.844035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:39.844035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:39.844035 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:39.844632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] HTTP exception thrown: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Request method failure captured: Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a HTTP/1.1 Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kXAjg8lZU09N3kQqF9hd8yfT4dMy8G8653xyi8KHyQHUUUCeGV2VdI22C3CSXaxnstY53iVVWhXxSLyT_o9_0qdta1icNZe4o-Zp8oB1JDKc_N47o59AFt0AW807XM_-ggFc_cCr_dWPJhNUHwxVUviDgSN9FD68EOBipD3qyZ1z6U Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:39.861233 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0fbadb872e74c57813900e5ebb6ac88", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}] Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: d3f9fac4e1de488b9964f988d238483a Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.862769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '73f381d7-b452-42ba-a0f0-1b4b74c3e07a'} Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:39.863691 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.865782 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.867275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Returning 404 to user: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:39.867275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5d6ec57a-5ba0-46d4-837b-0306d952ce3a tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "DELETE /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 404 len: 111 microversion: 2.1 time: 0.033849 Aug 12 12:31:39.867275 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 787/1538] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:31:39 2022] DELETE /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:39.873271 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:39.874640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] [instance: 73f381d7-b452-42ba-a0f0-1b4b74c3e07a] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:31:39.882408 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:39.882892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:39.883326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:39.884024 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:31:39.884575 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:31:39.885796 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:31:39.890659 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:31:39.903807 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] HTTP exception thrown: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Request method failure captured: Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a HTTP/1.1 Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kXAjg8lZU09N3kQqF9hd8yfT4dMy8G8653xyi8KHyQHUUUCeGV2VdI22C3CSXaxnstY53iVVWhXxSLyT_o9_0qdta1icNZe4o-Zp8oB1JDKc_N47o59AFt0AW807XM_-ggFc_cCr_dWPJhNUHwxVUviDgSN9FD68EOBipD3qyZ1z6U Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:39.905484 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0fbadb872e74c57813900e5ebb6ac88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0fbadb872e74c57813900e5ebb6ac88", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0fbadb872e74c57813900e5ebb6ac88"}]}] Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: c0fbadb872e74c57813900e5ebb6ac88 Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1217434021 Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: d3f9fac4e1de488b9964f988d238483a Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeTestJSON-1217434021-project Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.907134 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '73f381d7-b452-42ba-a0f0-1b4b74c3e07a'} Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:39.908158 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. Aug 12 12:31:39.909736 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:39.913705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] Returning 404 to user: Instance 73f381d7-b452-42ba-a0f0-1b4b74c3e07a could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:39.913705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-81e5051f-6c87-445c-82d5-08f50d83040d tempest-AttachVolumeTestJSON-1217434021 tempest-AttachVolumeTestJSON-1217434021-project] 10.222.0.27 "GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a" status: 404 len: 111 microversion: 2.1 time: 0.039888 Aug 12 12:31:39.913705 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 752/1539] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:31:39 2022] GET /compute/v2.1/servers/73f381d7-b452-42ba-a0f0-1b4b74c3e07a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:43.564805 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-dbb44e3e-daf7-43be-8b54-ad9e0db5718e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Action: 'create', calling method: .version_select at 0x7f990ef58940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1919259263"}} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:31:44.363092 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-dbb44e3e-daf7-43be-8b54-ad9e0db5718e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.947815 Aug 12 12:31:44.363986 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 788/1540] 10.222.0.27 () {60 vars in 1155 bytes} [Fri Aug 12 12:31:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 949 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 12:31:44.376211 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-516bc465-586a-451c-9b70-0cc8eb3dba33 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f9914062d30>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:44.444848 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-516bc465-586a-451c-9b70-0cc8eb3dba33 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53" status: 200 len: 345 microversion: 2.1 time: 0.072331 Aug 12 12:31:44.445587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 753/1541] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:31:44 2022] GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:45.459659 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-310fa100-0c8d-447c-857e-97da02178820 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f99176c9dc0>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:45.514057 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-310fa100-0c8d-447c-857e-97da02178820 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53" status: 200 len: 346 microversion: 2.1 time: 0.059426 Aug 12 12:31:45.515775 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 789/1542] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:31:45 2022] GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:45.527657 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-285e36f1-b048-468d-862b-fdff511b419b tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Action: 'create', calling method: .version_select at 0x7f990e976310>, body: {"snapshot": {"volume_id": "d198d2ef-694f-445a-891b-1499be553b53", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-204823690"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:31:46.041351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-285e36f1-b048-468d-862b-fdff511b419b tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.517896 Aug 12 12:31:46.042047 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 754/1543] 10.222.0.27 () {60 vars in 1162 bytes} [Fri Aug 12 12:31:45 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:31:46.052920 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-d947aed0-c2a0-44ce-bc81-742de4dff0f2 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f99176cda60>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:46.086688 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-d947aed0-c2a0-44ce-bc81-742de4dff0f2 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 200 len: 286 microversion: 2.1 time: 0.037769 Aug 12 12:31:46.087340 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 790/1544] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:31:46 2022] GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:46.097902 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8b767056-09ba-41ac-9a84-7ee2bfd38717 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f990e919ee0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:46.129076 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8b767056-09ba-41ac-9a84-7ee2bfd38717 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034853 Aug 12 12:31:46.136253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 755/1545] 10.222.0.27 () {58 vars in 1140 bytes} [Fri Aug 12 12:31:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:46.142146 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ecfadfe7-c4ef-4778-964d-896e6e471268 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f99177013a0>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:46.172594 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ecfadfe7-c4ef-4778-964d-896e6e471268 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 200 len: 286 microversion: 2.1 time: 0.034595 Aug 12 12:31:46.173318 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 791/1546] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:31:46 2022] GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:47.185533 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a85d526f-cc3f-4ec9-95bd-ec5c3e87769e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f990e920dc0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:47.375300 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a85d526f-cc3f-4ec9-95bd-ec5c3e87769e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 200 len: 286 microversion: 2.1 time: 0.194007 Aug 12 12:31:47.380130 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 756/1547] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:31:47 2022] GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 286 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:48.388306 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e161b0ec-5294-412d-9d6b-7524c09c9fe8 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f990ef6cca0>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:48.416359 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e161b0ec-5294-412d-9d6b-7524c09c9fe8 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 200 len: 286 microversion: 2.1 time: 0.032340 Aug 12 12:31:48.416961 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 792/1548] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:31:48 2022] GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:49.429772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-795d8f04-7dd4-47f7-b806-5396e4d6a586 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f990e934160>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:49.459527 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-795d8f04-7dd4-47f7-b806-5396e4d6a586 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 200 len: 286 microversion: 2.1 time: 0.034304 Aug 12 12:31:49.461095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 757/1549] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:31:49 2022] GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:50.470578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:31:50.471328 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:31:50.475602 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5b839193-233a-4af8-96a5-483ca19858e7 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f99176bbe50>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:50.505892 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5b839193-233a-4af8-96a5-483ca19858e7 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 200 len: 287 microversion: 2.1 time: 0.036572 Aug 12 12:31:50.506477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 793/1550] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:31:50 2022] GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:50.517757 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:31:50.522415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0410a3f9-468a-434c-8255-ff979084b14a tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f990e9761f0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:50.697309 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0410a3f9-468a-434c-8255-ff979084b14a tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 202 len: 0 microversion: 2.1 time: 0.180168 Aug 12 12:31:50.698669 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 758/1551] 10.222.0.27 () {58 vars in 1254 bytes} [Fri Aug 12 12:31:50 2022] DELETE /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:31:50.706988 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-20a1776e-1075-44b7-87ea-9f701bd5bb15 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f9917701310>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:50.737127 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-20a1776e-1075-44b7-87ea-9f701bd5bb15 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 200 len: 286 microversion: 2.1 time: 0.034541 Aug 12 12:31:50.737589 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 794/1552] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:31:50 2022] GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:51.751478 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5ebb574c-4ae4-479d-b520-10a8034a2a6e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f990effd430>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:51.795242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-5ebb574c-4ae4-479d-b520-10a8034a2a6e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] HTTP exception thrown: Snapshot b19b6614-bee4-43bc-84c7-db8e88adc487 could not be found. Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5ebb574c-4ae4-479d-b520-10a8034a2a6e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Request method failure captured: Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 HTTP/1.1 Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kgvmp2J_Kunfc7QVDOGcxop1C1P6Fbpc3YUtS_XV68mcZEglT2X1nvH32SM3xc6qUig5naHHOgMqJOXEkECJVmLecvieJj21X71nzvz-lAhdcorV9k2h6ku1z1pYKrB8P5QEHYEzaBN7fEAxAztRCW5REG5nGP_lrlB4RS6OZDxJcY Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3666c83d26314e4d885a782a0d473a80 Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:51.798056 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3666c83d26314e4d885a782a0d473a80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3666c83d26314e4d885a782a0d473a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3666c83d26314e4d885a782a0d473a80", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3666c83d26314e4d885a782a0d473a80"}]}] Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3666c83d26314e4d885a782a0d473a80 Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesSnapshotsTestJSON-908497917-project Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: a1224f280408487391fbe28d50a789c7 Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesSnapshotsTestJSON-908497917-project Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Snapshot b19b6614-bee4-43bc-84c7-db8e88adc487 could not be found. Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'b19b6614-bee4-43bc-84c7-db8e88adc487'} Aug 12 12:31:51.803930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b19b6614-bee4-43bc-84c7-db8e88adc487 could not be found. (HTTP 404) (Request-ID: req-fad93c30-fc45-42da-921b-6070848f4893) Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:51.805296 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:31:51.806607 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b19b6614-bee4-43bc-84c7-db8e88adc487 could not be found. Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 12 12:31:51.808162 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b19b6614-bee4-43bc-84c7-db8e88adc487 could not be found. Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b19b6614-bee4-43bc-84c7-db8e88adc487 could not be found. Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5ebb574c-4ae4-479d-b520-10a8034a2a6e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Returning 404 to user: Snapshot b19b6614-bee4-43bc-84c7-db8e88adc487 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:51.810729 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5ebb574c-4ae4-479d-b520-10a8034a2a6e tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487" status: 404 len: 111 microversion: 2.1 time: 0.052681 Aug 12 12:31:51.811885 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 759/1553] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 12 12:31:51 2022] GET /compute/v2.1/os-snapshots/b19b6614-bee4-43bc-84c7-db8e88adc487 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:51.812500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-190ad922-93af-41de-942e-387fbd45b516 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f99176cde50>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:52.038648 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-190ad922-93af-41de-942e-387fbd45b516 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53" status: 202 len: 0 microversion: 2.1 time: 0.233151 Aug 12 12:31:52.039402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 795/1554] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:31:51 2022] DELETE /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:31:52.048559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0406b973-8a60-4936-901a-795797ec020c tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f990e946f70>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:52.098319 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0406b973-8a60-4936-901a-795797ec020c tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53" status: 200 len: 345 microversion: 2.1 time: 0.054377 Aug 12 12:31:52.108044 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 760/1555] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:31:52 2022] GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:31:53.113064 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-60defebe-4976-47c8-9239-539a20b9d6af tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f99176c9550>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:53.142646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-60defebe-4976-47c8-9239-539a20b9d6af tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] HTTP exception thrown: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-60defebe-4976-47c8-9239-539a20b9d6af tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Request method failure captured: Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 HTTP/1.1 Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kgvmp2J_Kunfc7QVDOGcxop1C1P6Fbpc3YUtS_XV68mcZEglT2X1nvH32SM3xc6qUig5naHHOgMqJOXEkECJVmLecvieJj21X71nzvz-lAhdcorV9k2h6ku1z1pYKrB8P5QEHYEzaBN7fEAxAztRCW5REG5nGP_lrlB4RS6OZDxJcY Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3666c83d26314e4d885a782a0d473a80 Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:53.145011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3666c83d26314e4d885a782a0d473a80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3666c83d26314e4d885a782a0d473a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3666c83d26314e4d885a782a0d473a80", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3666c83d26314e4d885a782a0d473a80"}]}] Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3666c83d26314e4d885a782a0d473a80 Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesSnapshotsTestJSON-908497917-project Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: a1224f280408487391fbe28d50a789c7 Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesSnapshotsTestJSON-908497917-project Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'd198d2ef-694f-445a-891b-1499be553b53'} Aug 12 12:31:53.146660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. (HTTP 404) (Request-ID: req-c532927d-91aa-4529-b4e7-935431b2f15a) Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.147679 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:31:53.148945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 12:31:53.150223 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-60defebe-4976-47c8-9239-539a20b9d6af tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Returning 404 to user: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-60defebe-4976-47c8-9239-539a20b9d6af tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53" status: 404 len: 109 microversion: 2.1 time: 0.038121 Aug 12 12:31:53.151581 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 796/1556] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:31:53 2022] GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:53.162300 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8ad3ca19-3aab-4b2e-a802-54e383c5bbaf tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f990e919ee0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:53.221651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-8ad3ca19-3aab-4b2e-a802-54e383c5bbaf tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] HTTP exception thrown: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8ad3ca19-3aab-4b2e-a802-54e383c5bbaf tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Request method failure captured: Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: DELETE /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 HTTP/1.1 Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kgvmp2J_Kunfc7QVDOGcxop1C1P6Fbpc3YUtS_XV68mcZEglT2X1nvH32SM3xc6qUig5naHHOgMqJOXEkECJVmLecvieJj21X71nzvz-lAhdcorV9k2h6ku1z1pYKrB8P5QEHYEzaBN7fEAxAztRCW5REG5nGP_lrlB4RS6OZDxJcY Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 3666c83d26314e4d885a782a0d473a80 Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:31:53.223970 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3666c83d26314e4d885a782a0d473a80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3666c83d26314e4d885a782a0d473a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3666c83d26314e4d885a782a0d473a80", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3666c83d26314e4d885a782a0d473a80"}]}] Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 3666c83d26314e4d885a782a0d473a80 Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesSnapshotsTestJSON-908497917-project Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: a1224f280408487391fbe28d50a789c7 Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesSnapshotsTestJSON-908497917-project Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': 'd198d2ef-694f-445a-891b-1499be553b53'} Aug 12 12:31:53.225651 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. (HTTP 404) (Request-ID: req-db9ed7f0-a3b6-45fb-b74f-5138ebd7fe99) Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.226640 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 12:31:53.228203 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 12:31:53.229770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8ad3ca19-3aab-4b2e-a802-54e383c5bbaf tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Returning 404 to user: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:53.231996 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8ad3ca19-3aab-4b2e-a802-54e383c5bbaf tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53" status: 404 len: 109 microversion: 2.1 time: 0.067353 Aug 12 12:31:53.235135 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-71c6b804-3a67-4b3d-b17c-b4b0b72a4ef5 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Calling method '.version_select at 0x7f99176c93a0>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:31:53.236795 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 761/1557] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 12 12:31:53 2022] DELETE /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-71c6b804-3a67-4b3d-b17c-b4b0b72a4ef5 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] HTTP exception thrown: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-71c6b804-3a67-4b3d-b17c-b4b0b72a4ef5 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Request method failure captured: Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 HTTP/1.1 Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kgvmp2J_Kunfc7QVDOGcxop1C1P6Fbpc3YUtS_XV68mcZEglT2X1nvH32SM3xc6qUig5naHHOgMqJOXEkECJVmLecvieJj21X71nzvz-lAhdcorV9k2h6ku1z1pYKrB8P5QEHYEzaBN7fEAxAztRCW5REG5nGP_lrlB4RS6OZDxJcY Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 3666c83d26314e4d885a782a0d473a80 Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:31:53.279790 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3666c83d26314e4d885a782a0d473a80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3666c83d26314e4d885a782a0d473a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3666c83d26314e4d885a782a0d473a80", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3666c83d26314e4d885a782a0d473a80"}]}] Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 3666c83d26314e4d885a782a0d473a80 Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-908497917 Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-VolumesSnapshotsTestJSON-908497917-project Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: a1224f280408487391fbe28d50a789c7 Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-VolumesSnapshotsTestJSON-908497917-project Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': 'd198d2ef-694f-445a-891b-1499be553b53'} Aug 12 12:31:53.281496 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. (HTTP 404) (Request-ID: req-1fc7df11-66fe-47a6-86b0-e1d2f57efb70) Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.282795 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 12:31:53.284350 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 12:31:53.286974 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-71c6b804-3a67-4b3d-b17c-b4b0b72a4ef5 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] Returning 404 to user: Volume d198d2ef-694f-445a-891b-1499be553b53 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-71c6b804-3a67-4b3d-b17c-b4b0b72a4ef5 tempest-VolumesSnapshotsTestJSON-908497917 tempest-VolumesSnapshotsTestJSON-908497917-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53" status: 404 len: 109 microversion: 2.1 time: 0.040081 Aug 12 12:31:53.290351 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 797/1558] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 12 12:31:53 2022] GET /compute/v2.1/os-volumes/d198d2ef-694f-445a-891b-1499be553b53 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:32:22.328569 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:32:22.336301 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Fri Aug 12 12:32:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:32:24.863829 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:32:24.864314 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:32:37.486218 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1891357488", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1386494864", "security_groups": [{"name": "tempest-secgroup-smoke-1845293560"}], "block_device_mapping_v2": [{"uuid": "7ac70a0a-31ae-4f53-8a1b-502015f71c75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "34bda1c6-3fac-4d1d-b2d0-884ebbdd299a"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:32:37.602872 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] validate_networks() for [('34bda1c6-3fac-4d1d-b2d0-884ebbdd299a', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 12:32:37.970924 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 12:32:37.971336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 12:32:37.971797 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 12:32:37.972194 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 12:32:37.972595 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 12:32:37.981377 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:37.981846 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:37.982273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:37.983007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:37.983474 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:37.983885 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:38.002740 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Getting quotas for project 566d2428ccbe41888b9619faf5f212a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 12:32:38.006594 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Getting quotas for user a90e3591b4144fdfb8b5ed5391aec7c6 and project 566d2428ccbe41888b9619faf5f212a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 12:32:38.066061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 12:32:38.066061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ac70a0a-31ae-4f53-8a1b-502015f71c75',volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 12:32:38.436216 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5dec3b14-0fe3-48e8-b961-2cf666e23b27 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955134 Aug 12 12:32:38.440618 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 762/1559] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 12 12:32:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 12:32:38.449841 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0ec0b9b6-7dbd-4b63-8f5d-ed3b0cdfcc87 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:38.450606 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0ec0b9b6-7dbd-4b63-8f5d-ed3b0cdfcc87 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:38.513719 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0ec0b9b6-7dbd-4b63-8f5d-ed3b0cdfcc87 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:38.523232 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0ec0b9b6-7dbd-4b63-8f5d-ed3b0cdfcc87 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1095 microversion: 2.1 time: 0.078440 Aug 12 12:32:38.537470 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 798/1560] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:38 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:39.543350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:39.543968 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:39.550966 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:39.551453 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:39.551893 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:39.559007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:39.559007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:39.559007 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:39.771250 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:39.778706 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ca23f443-d481-4371-8a57-8691f93753d3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1145 microversion: 2.1 time: 0.239476 Aug 12 12:32:39.779253 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 763/1561] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:39 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1145 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:40.799847 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:40.800463 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:40.807469 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:40.807972 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:40.808409 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:40.809141 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:40.809592 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:40.810017 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:40.871769 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:40.879241 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-87e9978b-bdb0-4b16-9d12-d84cb2a5b9dc tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1145 microversion: 2.1 time: 0.083340 Aug 12 12:32:40.879802 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 799/1562] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:40 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:41.902101 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:41.902713 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:41.909593 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:41.910082 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:41.910516 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:41.911200 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:41.911650 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:41.912071 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:41.973022 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:41.981862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-55e37f20-9bf4-4d04-98ab-8b7ca0f39530 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1193 microversion: 2.1 time: 0.084244 Aug 12 12:32:41.982415 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 764/1563] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:41 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:43.002938 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:43.004143 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:43.010676 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:43.011159 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:43.011595 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:43.012280 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:43.012759 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:43.017112 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:43.073403 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:43.081166 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-30c3e0a1-8aba-499d-9adc-7a4d0006f21e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1211 microversion: 2.1 time: 0.082049 Aug 12 12:32:43.081746 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 800/1564] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:42 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:44.102717 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:44.103303 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:44.109713 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:44.110197 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:44.110630 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:44.111316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:44.111766 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:44.112187 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:44.241466 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:44.249440 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c0a91d0a-8d30-4ab1-be43-2a118dd7fa6a tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1279 microversion: 2.1 time: 0.150560 Aug 12 12:32:44.249992 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 765/1565] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:44 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:45.270771 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:45.271375 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:45.278587 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:45.279068 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:45.279524 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:45.280185 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:45.280660 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:45.281282 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:45.487636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:45.495628 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-9bcce3c2-359e-496d-b304-db3f1fbba7b0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1279 microversion: 2.1 time: 0.228860 Aug 12 12:32:45.496198 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 801/1566] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:45 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:32:46.009576 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-4201cb33-0536-450a-8ebe-3fa3112d243d req-5ab96930-d043-48f6-a483-23c8eba213dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf89f0-d41b-47d8-b0d3-ed816d1b6417", "tag": "e5bf5634-8eeb-428a-a0bd-5e2acd367fab"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:32:46.019332 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4201cb33-0536-450a-8ebe-3fa3112d243d req-5ab96930-d043-48f6-a483-23c8eba213dc service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:46.019807 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4201cb33-0536-450a-8ebe-3fa3112d243d req-5ab96930-d043-48f6-a483-23c8eba213dc service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:46.020241 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4201cb33-0536-450a-8ebe-3fa3112d243d req-5ab96930-d043-48f6-a483-23c8eba213dc service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:46.030991 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-4201cb33-0536-450a-8ebe-3fa3112d243d req-5ab96930-d043-48f6-a483-23c8eba213dc service nova] Creating event network-changed:e5bf5634-8eeb-428a-a0bd-5e2acd367fab for instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 on hv-cinder-79797 Aug 12 12:32:46.035840 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-4201cb33-0536-450a-8ebe-3fa3112d243d req-5ab96930-d043-48f6-a483-23c8eba213dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030034 Aug 12 12:32:46.036650 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 766/1567] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:32:46.515495 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:46.516128 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:46.522917 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:46.523391 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:46.523865 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:46.524762 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:46.525212 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:46.525636 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:46.730216 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:46.737923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7707c5c3-5010-4b11-b59c-75e8ea2a045d tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1279 microversion: 2.1 time: 0.226213 Aug 12 12:32:46.739850 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 802/1568] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:46 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:47.760489 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:47.761139 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:47.767462 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:47.767942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:47.768457 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:47.769221 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:47.769678 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:47.770104 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:47.907847 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:47.915747 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6150daea-c0f1-4a64-bc04-d441ec2eb070 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1279 microversion: 2.1 time: 0.160325 Aug 12 12:32:47.916524 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 767/1569] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:47 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:48.937102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:48.937705 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:48.940155 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell0:SELECT=2 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:32:48.945229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:48.948229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:48.948229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:48.948229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:48.948229 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:48.948613 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:49.085434 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:49.103148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8877ab09-ec48-46db-aaef-2218283b0815 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1279 microversion: 2.1 time: 0.160941 Aug 12 12:32:49.103148 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 803/1570] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:48 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:50.114670 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:50.115704 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:50.117328 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:32:50.118000 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:32:50.123351 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:50.123835 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:50.124273 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:50.124994 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:50.125452 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:50.125886 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:50.266887 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:50.270758 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-80780c4e-c5bf-40d7-957b-a053e6777241 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.160033 Aug 12 12:32:50.271297 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 768/1571] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:50 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:51.297682 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:51.298398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:51.309075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:51.309075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:51.309075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:51.309075 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:51.309818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:51.309818 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:51.449907 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:51.457596 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7ca592da-cf46-4a13-8e5c-53484b169bf1 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.163661 Aug 12 12:32:51.458294 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 804/1572] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:51 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:52.479530 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:52.480159 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:52.487121 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:52.487604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:52.488046 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:52.488769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:52.489225 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:52.489661 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:52.624744 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:52.632350 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8a8e2731-48dc-4c46-9950-ea4ad9595c52 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.156724 Aug 12 12:32:52.635594 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 769/1573] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:52 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:53.653455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:53.654062 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:53.660002 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:53.660472 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:53.660948 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:53.661630 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:53.662074 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:53.662491 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:53.796621 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:53.804250 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-0eef5b17-d197-47e8-b49d-e1c8ac56ce38 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.155616 Aug 12 12:32:53.805385 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 805/1574] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:53 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:54.826019 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:54.826645 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:54.832990 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:54.833470 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:54.833903 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:54.834589 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:54.835037 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:54.835457 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:54.965903 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:54.973300 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-aa546f5f-a4d7-4e36-89c4-c37a43c4c5ff tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.151199 Aug 12 12:32:54.973850 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 770/1575] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:54 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:55.993900 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:55.994494 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:56.000883 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:56.001358 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:56.001844 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:56.002519 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:56.002965 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:56.003383 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:56.131045 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:56.138588 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-42849a22-e61e-4c1b-a0de-7ef21402f770 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.148706 Aug 12 12:32:56.139167 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 806/1576] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:55 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:57.159322 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:57.159930 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:57.166749 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:57.167226 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:57.167663 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:57.168393 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:57.168865 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:57.169286 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:57.302896 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:57.310850 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6d8a84ae-53d3-4c22-8a43-693d49003dc8 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.155414 Aug 12 12:32:57.311402 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 771/1577] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:57 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:58.331861 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:58.332476 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:58.339397 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:58.339866 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:58.340299 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:58.341009 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:58.341453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:58.341869 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:58.477361 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:58.484774 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f35b3f77-9422-4384-bc24-0c6a9a80d635 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.157129 Aug 12 12:32:58.485341 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 807/1578] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:58 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:32:59.506300 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:32:59.506914 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:32:59.513522 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:59.516475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:59.516475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:59.516475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:32:59.516475 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:32:59.516944 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:32:59.659701 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:32:59.671307 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-178c489d-785d-412e-bd3f-234035b9a8d9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.169243 Aug 12 12:32:59.672191 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 772/1579] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:32:59 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:00.693716 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:00.694330 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:00.702007 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:00.705060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:00.705060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:00.705060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:00.705060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:00.705483 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:00.839414 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:00.847481 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-e0151bdb-2082-4770-9dcd-65a2f0d50cfa tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.157581 Aug 12 12:33:00.848118 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 808/1580] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:00 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:01.868932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:01.869602 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:01.875952 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:01.876430 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:01.876904 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:01.877587 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:01.878035 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:01.878458 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:02.084778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:02.092697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6cd9b48b-22f2-4706-a8ff-7fb2415ebce4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.228162 Aug 12 12:33:02.093262 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 773/1581] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:01 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:03.113619 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:03.114177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:03.121692 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:03.122211 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:03.122623 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:03.123325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:03.123780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:03.124203 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:03.259602 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:03.264646 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c7a64d8d-43bf-461a-8b07-3158d2a34d32 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.154950 Aug 12 12:33:03.265453 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 809/1582] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:03 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:04.287426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:04.287426 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:04.293539 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:04.294110 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:04.294563 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:04.295326 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:04.295812 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:04.296238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:04.432585 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:04.440021 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-27ad7fd5-32d8-4e3b-bb21-3d9859f8ab9e tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.158784 Aug 12 12:33:04.440619 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 774/1583] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:04 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:05.466544 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:05.467147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:05.473710 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:05.474398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:05.474835 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:05.475562 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:05.476222 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:05.476683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:05.613664 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:05.622124 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5dd81b79-8197-4596-aaf9-08913a8271a6 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.159586 Aug 12 12:33:05.622728 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 810/1584] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:05 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:06.083562 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-6c991bdd-b85f-4ded-bd3a-9626be37df07 req-4fefbf67-a850-4420-b7f7-9b65a56805f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acf89f0-d41b-47d8-b0d3-ed816d1b6417", "name": "network-vif-plugged", "status": "completed", "tag": "e5bf5634-8eeb-428a-a0bd-5e2acd367fab"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:33:06.094305 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6c991bdd-b85f-4ded-bd3a-9626be37df07 req-4fefbf67-a850-4420-b7f7-9b65a56805f4 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:06.094783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6c991bdd-b85f-4ded-bd3a-9626be37df07 req-4fefbf67-a850-4420-b7f7-9b65a56805f4 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:06.095211 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6c991bdd-b85f-4ded-bd3a-9626be37df07 req-4fefbf67-a850-4420-b7f7-9b65a56805f4 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:06.106061 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-6c991bdd-b85f-4ded-bd3a-9626be37df07 req-4fefbf67-a850-4420-b7f7-9b65a56805f4 service nova] Creating event network-vif-plugged:e5bf5634-8eeb-428a-a0bd-5e2acd367fab for instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 on hv-cinder-79797 Aug 12 12:33:06.111028 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-6c991bdd-b85f-4ded-bd3a-9626be37df07 req-4fefbf67-a850-4420-b7f7-9b65a56805f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031521 Aug 12 12:33:06.116783 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 775/1585] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:33:06.642833 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:06.643444 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:06.651292 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:06.652248 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:06.653625 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:06.654387 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:06.655119 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:06.655826 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:06.792449 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:06.800004 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-f10370d3-de14-4e24-8b81-509d1d75d389 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.161230 Aug 12 12:33:06.800578 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 811/1586] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:06 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:07.822697 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:07.823487 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:07.825624 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:33:07.830913 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:07.831606 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:07.832205 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:07.833092 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:07.833698 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:07.834274 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:07.840189 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=73 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:33:07.977870 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:07.986025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9856acbc-2178-4650-8cda-421f8bcb9ed3 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1267 microversion: 2.1 time: 0.168957 Aug 12 12:33:07.986604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 776/1587] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:07 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:09.006078 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:09.006945 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:09.009944 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=31 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:33:09.014880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:09.015459 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:09.016563 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:09.017363 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:09.017811 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:09.018436 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:09.022668 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=79 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:33:09.156946 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:09.165958 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-41342e2c-0f21-4f34-b29f-786cb6e478b4 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1455 microversion: 2.1 time: 0.163672 Aug 12 12:33:09.166726 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 812/1588] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:09 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:09.186468 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:33:09.187238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:33:09.194945 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:09.195429 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:09.196654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:09.196654 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:09.197688 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:09.198150 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:09.345258 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:33:09.353383 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0a3cc3df-47c3-4bec-83af-da828c0a4677 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1455 microversion: 2.1 time: 0.170620 Aug 12 12:33:09.354074 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 777/1589] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:33:09 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:33:12.024435 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-53ddc821-6ee1-477f-b347-bfd040808776 req-5d3f67c4-94f4-442e-8b33-0472492dfe53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf89f0-d41b-47d8-b0d3-ed816d1b6417", "tag": "e5bf5634-8eeb-428a-a0bd-5e2acd367fab"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:33:12.041402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-53ddc821-6ee1-477f-b347-bfd040808776 req-5d3f67c4-94f4-442e-8b33-0472492dfe53 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:33:12.041402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-53ddc821-6ee1-477f-b347-bfd040808776 req-5d3f67c4-94f4-442e-8b33-0472492dfe53 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:33:12.041402 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-53ddc821-6ee1-477f-b347-bfd040808776 req-5d3f67c4-94f4-442e-8b33-0472492dfe53 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:33:12.061925 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-53ddc821-6ee1-477f-b347-bfd040808776 req-5d3f67c4-94f4-442e-8b33-0472492dfe53 service nova] Creating event network-changed:e5bf5634-8eeb-428a-a0bd-5e2acd367fab for instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 on hv-cinder-79797 Aug 12 12:33:12.068240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-53ddc821-6ee1-477f-b347-bfd040808776 req-5d3f67c4-94f4-442e-8b33-0472492dfe53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295938 Aug 12 12:33:12.069177 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 813/1590] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:34:05.464095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:34:05.464769 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:34:06.078929 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:34:06.079479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Fri Aug 12 12:34:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:35:15.478143 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=11 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:35:15.480271 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c869742b-1643-4828-b665-c8b7a6676cb3] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 12 12:35:15.480990 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_api:SELECT=3 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:35:15.482196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG dbcounter [-] [121154] Writing DB stats nova_cell1:SELECT=7 {{(pid=121154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:35:15.485135 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:15.485730 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:15.486838 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [req-98c33408-0fd1-43c6-8339-697a0b4d6dd0 req-5b0d8719-5f77-4e8c-b00f-528576f901de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf89f0-d41b-47d8-b0d3-ed816d1b6417", "tag": "e5bf5634-8eeb-428a-a0bd-5e2acd367fab"}]} {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:35:15.492298 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:15.498862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:15.498862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:15.498862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:15.498862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:15.499279 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:15.499477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-98c33408-0fd1-43c6-8339-697a0b4d6dd0 req-5b0d8719-5f77-4e8c-b00f-528576f901de service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:15.499477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-98c33408-0fd1-43c6-8339-697a0b4d6dd0 req-5b0d8719-5f77-4e8c-b00f-528576f901de service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:15.499477 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [req-98c33408-0fd1-43c6-8339-697a0b4d6dd0 req-5b0d8719-5f77-4e8c-b00f-528576f901de service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:15.513398 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.compute.server_external_events [req-98c33408-0fd1-43c6-8339-697a0b4d6dd0 req-5b0d8719-5f77-4e8c-b00f-528576f901de service nova] Creating event network-changed:e5bf5634-8eeb-428a-a0bd-5e2acd367fab for instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 on hv-cinder-79797 Aug 12 12:35:15.518855 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [req-98c33408-0fd1-43c6-8339-697a0b4d6dd0 req-5b0d8719-5f77-4e8c-b00f-528576f901de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040195 Aug 12 12:35:15.524484 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 814/1591] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:35:15.525079 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:35:15.933122 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c1a58a59-9bb2-40c5-a76d-4a1f89ac72c7 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 204 len: 0 microversion: 2.1 time: 0.457191 Aug 12 12:35:15.933909 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 778/1592] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:35:15 2022] DELETE /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:35:15.944196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:15.944912 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:15.952456 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:15.952989 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:15.953426 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:15.954114 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:15.954772 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:15.955188 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:16.208633 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:35:16.216610 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-822007bb-9593-427e-8477-95c30c25ec02 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1579 microversion: 2.1 time: 0.277334 Aug 12 12:35:16.217200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 815/1593] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:15 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1579 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:35:17.238762 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:17.239460 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:17.246336 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:17.247660 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:17.248126 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:17.248863 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:17.249316 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:17.249741 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:17.435282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:35:17.442841 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-65601f44-f736-48dc-928e-300d0c45f47f tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1461 microversion: 2.1 time: 0.208521 Aug 12 12:35:17.443390 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 779/1594] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:17 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1461 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:35:18.463780 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:18.464394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:18.472200 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:18.472712 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:18.473153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:18.473846 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:18.474296 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:18.474721 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:18.492169 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO oslo.messaging._drivers.impl_rabbit [-] [c869742b-1643-4828-b665-c8b7a6676cb3] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 60904. Aug 12 12:35:18.560560 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:35:18.569325 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-7ae7299c-7409-43ba-9d72-bcb0e577aaed tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1393 microversion: 2.1 time: 0.109275 Aug 12 12:35:18.569902 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 816/1595] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:18 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1393 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:35:18.634388 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-53e33ac6-7467-4d79-8fa2-a32c145e8ac0 req-b2d7a828-3201-4271-b3c5-020b989f5a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acf89f0-d41b-47d8-b0d3-ed816d1b6417", "name": "network-vif-deleted", "tag": "e5bf5634-8eeb-428a-a0bd-5e2acd367fab"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:35:18.643723 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-53e33ac6-7467-4d79-8fa2-a32c145e8ac0 req-b2d7a828-3201-4271-b3c5-020b989f5a36 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:18.644276 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-53e33ac6-7467-4d79-8fa2-a32c145e8ac0 req-b2d7a828-3201-4271-b3c5-020b989f5a36 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:18.644735 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-53e33ac6-7467-4d79-8fa2-a32c145e8ac0 req-b2d7a828-3201-4271-b3c5-020b989f5a36 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:18.655746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-53e33ac6-7467-4d79-8fa2-a32c145e8ac0 req-b2d7a828-3201-4271-b3c5-020b989f5a36 service nova] Creating event network-vif-deleted:e5bf5634-8eeb-428a-a0bd-5e2acd367fab for instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 on hv-cinder-79797 Aug 12 12:35:18.661911 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-53e33ac6-7467-4d79-8fa2-a32c145e8ac0 req-b2d7a828-3201-4271-b3c5-020b989f5a36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091461 Aug 12 12:35:18.662508 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 780/1596] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 12:35:19.592437 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:19.593107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:19.599514 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:19.600021 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:19.600457 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:19.601240 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:19.601689 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:19.602111 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:19.632501 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:19.633011 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:19.633441 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:19.633880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:35:19.674632 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:35:19.682111 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-ae2277d6-4e77-45ce-bcf0-22447865b7e2 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 200 len: 1231 microversion: 2.1 time: 0.094417 Aug 12 12:35:19.682666 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 817/1597] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:19 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:35:20.704086 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:20.704806 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 9acf89f0-d41b-47d8-b0d3-ed816d1b6417] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:20.711361 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:20.712095 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:20.712531 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:20.713242 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:20.713693 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:20.714116 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:20.727673 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] HTTP exception thrown: Instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 could not be found. Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Request method failure captured: Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 HTTP/1.1 Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kbb5t_HdNw58DciX5gmMeLVVyC7Q7EIFW3eulNSsO8S7BZ0di1-kWZqj_IpQj4KPnjJpGFFMYMtyYha3M-RkPxkgN15KHIYLAiArwHPw4a_icVz0zRAu2cD-CK9noxRVg04knPjXPsfP-dZxP_kK9v-WxbsuOmnNKN5MQ-ojog38DY Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:35:20.729335 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_566d2428ccbe41888b9619faf5f212a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}] Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: a90e3591b4144fdfb8b5ed5391aec7c6 Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 could not be found. Aug 12 12:35:20.731198 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '9acf89f0-d41b-47d8-b0d3-ed816d1b6417'} Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 could not be found. Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:35:20.733093 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 could not be found. Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 could not be found. Aug 12 12:35:20.734833 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:20.736768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Returning 404 to user: Instance 9acf89f0-d41b-47d8-b0d3-ed816d1b6417 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:35:20.736768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dcf0f9b7-e5d2-44d4-b2b6-d646e9383f49 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417" status: 404 len: 111 microversion: 2.1 time: 0.030908 Aug 12 12:35:20.736768 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 781/1598] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:20 2022] GET /compute/v2.1/servers/9acf89f0-d41b-47d8-b0d3-ed816d1b6417 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 12:35:24.103147 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:24.103672 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:24.105734 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-7f4bcbb2-0def-4ae1-a9af-608f43a91697 req-411a574d-9d88-4cef-b681-84ad915bf281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e558e8-dded-4925-8f10-29a712673bcf", "tag": "5746b817-61d3-408a-b08d-85930765c2e4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:35:24.110153 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:24.111079 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:24.111513 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:24.112479 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:24.113033 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:24.113528 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:24.117220 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7f4bcbb2-0def-4ae1-a9af-608f43a91697 req-411a574d-9d88-4cef-b681-84ad915bf281 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:24.118077 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7f4bcbb2-0def-4ae1-a9af-608f43a91697 req-411a574d-9d88-4cef-b681-84ad915bf281 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:24.118516 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7f4bcbb2-0def-4ae1-a9af-608f43a91697 req-411a574d-9d88-4cef-b681-84ad915bf281 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:24.131984 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-7f4bcbb2-0def-4ae1-a9af-608f43a91697 req-411a574d-9d88-4cef-b681-84ad915bf281 service nova] Creating event network-changed:5746b817-61d3-408a-b08d-85930765c2e4 for instance 94e558e8-dded-4925-8f10-29a712673bcf on hv-cinder-79797 Aug 12 12:35:24.137238 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-7f4bcbb2-0def-4ae1-a9af-608f43a91697 req-411a574d-9d88-4cef-b681-84ad915bf281 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035434 Aug 12 12:35:24.137875 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 782/1599] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:35:24.139880 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Going to try to terminate instance {{(pid=121154) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 12:35:24.447909 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-6ae8a2ea-0b42-4e4c-a872-f7dfb4eb8451 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 204 len: 0 microversion: 2.1 time: 0.348319 Aug 12 12:35:24.448516 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 818/1600] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:35:24 2022] DELETE /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 12:35:24.458320 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:24.459241 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:24.467604 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:24.468235 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:24.468778 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:24.469940 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:24.470777 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:24.471277 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:24.615287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:35:24.622726 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b5ca0ac9-6725-4f45-b6bf-faeb464190ef tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1577 microversion: 2.1 time: 0.169357 Aug 12 12:35:24.623282 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 783/1601] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:24 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:35:25.646095 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:25.646793 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:25.653276 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:25.653763 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:25.654196 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:25.654884 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:25.655336 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:25.655755 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:26.120663 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:35:26.128927 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-5d471f87-9099-4363-94e0-5157d430fc86 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1459 microversion: 2.1 time: 0.487765 Aug 12 12:35:26.129500 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 819/1602] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:25 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1459 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 12:35:26.395685 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-456d466e-2359-4831-acfa-8b0b99aeb6ef req-c06ee752-a9db-460a-9d48-83281e525a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e558e8-dded-4925-8f10-29a712673bcf", "name": "network-vif-deleted", "tag": "5746b817-61d3-408a-b08d-85930765c2e4"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 12:35:26.405892 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-456d466e-2359-4831-acfa-8b0b99aeb6ef req-c06ee752-a9db-460a-9d48-83281e525a03 service nova] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:26.406387 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-456d466e-2359-4831-acfa-8b0b99aeb6ef req-c06ee752-a9db-460a-9d48-83281e525a03 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:26.406814 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-456d466e-2359-4831-acfa-8b0b99aeb6ef req-c06ee752-a9db-460a-9d48-83281e525a03 service nova] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:26.418510 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-456d466e-2359-4831-acfa-8b0b99aeb6ef req-c06ee752-a9db-460a-9d48-83281e525a03 service nova] Creating event network-vif-deleted:5746b817-61d3-408a-b08d-85930765c2e4 for instance 94e558e8-dded-4925-8f10-29a712673bcf on hv-cinder-79797 Aug 12 12:35:26.424772 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-456d466e-2359-4831-acfa-8b0b99aeb6ef req-c06ee752-a9db-460a-9d48-83281e525a03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032511 Aug 12 12:35:26.425436 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 784/1603] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 12 12:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 12:35:27.149901 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:27.150510 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:27.157162 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:27.160465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:27.160465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:27.160465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:27.160465 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:27.160991 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:27.191343 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:27.191827 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:27.192260 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:27.192723 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.objects.instance [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lazy-loading 'fault' on Instance uuid 94e558e8-dded-4925-8f10-29a712673bcf {{(pid=121154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 12:35:27.235698 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.policy [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90e3591b4144fdfb8b5ed5391aec7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d2428ccbe41888b9619faf5f212a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121154) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 12:35:27.243154 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-c8b77ad5-7539-4bae-b199-0e350184f33c tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 200 len: 1230 microversion: 2.1 time: 0.097293 Aug 12 12:35:27.243723 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 820/1604] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:27 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 12:35:28.264928 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:28.265620 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 94e558e8-dded-4925-8f10-29a712673bcf] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:28.272421 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:28.272921 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:28.273352 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:28.274025 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:28.274471 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:28.274888 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:28.287932 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] HTTP exception thrown: Instance 94e558e8-dded-4925-8f10-29a712673bcf could not be found. Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Request method failure captured: Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf HTTP/1.1 Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kbb5t_HdNw58DciX5gmMeLVVyC7Q7EIFW3eulNSsO8S7BZ0di1-kWZqj_IpQj4KPnjJpGFFMYMtyYha3M-RkPxkgN15KHIYLAiArwHPw4a_icVz0zRAu2cD-CK9noxRVg04knPjXPsfP-dZxP_kK9v-WxbsuOmnNKN5MQ-ojog38DY Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:35:28.289547 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_566d2428ccbe41888b9619faf5f212a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}] Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: a90e3591b4144fdfb8b5ed5391aec7c6 Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 94e558e8-dded-4925-8f10-29a712673bcf could not be found. Aug 12 12:35:28.291287 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '94e558e8-dded-4925-8f10-29a712673bcf'} Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e558e8-dded-4925-8f10-29a712673bcf could not be found. Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:35:28.292480 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e558e8-dded-4925-8f10-29a712673bcf could not be found. Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e558e8-dded-4925-8f10-29a712673bcf could not be found. Aug 12 12:35:28.294107 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.295770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Returning 404 to user: Instance 94e558e8-dded-4925-8f10-29a712673bcf could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:35:28.295770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d3374d3b-d0d6-4120-99ac-9a7a772b9de9 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf" status: 404 len: 111 microversion: 2.1 time: 0.030689 Aug 12 12:35:28.295770 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 785/1605] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:28 2022] GET /compute/v2.1/servers/94e558e8-dded-4925-8f10-29a712673bcf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:35:28.795367 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:28.795893 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.compute.api [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121154) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:28.802914 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:28.803394 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:28.803828 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:28.804549 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:28.805030 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:28.805455 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG oslo_concurrency.lockutils [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:28.822010 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.wsgi [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] HTTP exception thrown: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Request method failure captured: Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: request: DELETE /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 HTTP/1.1 Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept: application/json Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Accept-Encoding: identity Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Connection: close Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Length: 0 Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Content-Type: application/json Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Host: 10.222.0.27 Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Openstack-System-Scope: None Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: User-Agent: python-urllib3/1.26.11 Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Auth-Token: gAAAAABi9kbb5t_HdNw58DciX5gmMeLVVyC7Q7EIFW3eulNSsO8S7BZ0di1-kWZqj_IpQj4KPnjJpGFFMYMtyYha3M-RkPxkgN15KHIYLAiArwHPw4a_icVz0zRAu2cD-CK9noxRVg04knPjXPsfP-dZxP_kK9v-WxbsuOmnNKN5MQ-ojog38DY Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Id: None Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Domain-Name: None Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Identity-Status: Confirmed Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Is-Admin-Project: True Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Id: default Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Domain-Name: Default Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Project-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Role: reader,member Aug 12 12:35:28.823645 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Roles: reader,member Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_566d2428ccbe41888b9619faf5f212a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}] Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-Tenant-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Id: default Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Domain-Name: Default Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Id: a90e3591b4144fdfb8b5ed5391aec7c6 Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: X-User-Name: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: method: > Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: exception: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.825396 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: action_args: {'id': '246a125c-dd37-4c1c-880b-b7ddf37ebd11'} Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:35:28.826452 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.828102 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.830067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Returning 404 to user: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. {{(pid=121154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:35:28.830067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-15e66344-3594-4045-b311-38cdb90cb213 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 404 len: 111 microversion: 2.1 time: 0.033542 Aug 12 12:35:28.830067 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 821/1606] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 12 12:35:28 2022] DELETE /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:35:28.833855 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:28.834600 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] [instance: 246a125c-dd37-4c1c-880b-b7ddf37ebd11] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 12:35:28.840862 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:28.841342 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:28.841781 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:28.842491 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Acquiring lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 12:35:28.842942 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 12:35:28.843366 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Lock "2cc624e5-3553-4a43-9cb3-e1cc814c6191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 12:35:28.856627 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] HTTP exception thrown: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Request method failure captured: Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 HTTP/1.1 Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept: application/json Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Connection: close Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Length: 0 Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Content-Type: application/json Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Host: 10.222.0.27 Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.11 Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABi9kbb5t_HdNw58DciX5gmMeLVVyC7Q7EIFW3eulNSsO8S7BZ0di1-kWZqj_IpQj4KPnjJpGFFMYMtyYha3M-RkPxkgN15KHIYLAiArwHPw4a_icVz0zRAu2cD-CK9noxRVg04knPjXPsfP-dZxP_kK9v-WxbsuOmnNKN5MQ-ojog38DY Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Role: reader,member Aug 12 12:35:28.858192 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/566d2428ccbe41888b9619faf5f212a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_566d2428ccbe41888b9619faf5f212a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/566d2428ccbe41888b9619faf5f212a2"}]}] Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 566d2428ccbe41888b9619faf5f212a2 Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestVolumeBootPattern-266125350 Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Id: a90e3591b4144fdfb8b5ed5391aec7c6 Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestVolumeBootPattern-266125350-project Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: method: > Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: exception: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.860523 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: action_args: {'id': '246a125c-dd37-4c1c-880b-b7ddf37ebd11'} Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 12:35:28.861559 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. Aug 12 12:35:28.863179 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Aug 12 12:35:28.864613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Returning 404 to user: Instance 246a125c-dd37-4c1c-880b-b7ddf37ebd11 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 12:35:28.864613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b60f6ea0-3da1-4654-abf9-0caa68c90ab0 tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11" status: 404 len: 111 microversion: 2.1 time: 0.029624 Aug 12 12:35:28.864613 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 786/1607] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 12 12:35:28 2022] GET /compute/v2.1/servers/246a125c-dd37-4c1c-880b-b7ddf37ebd11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 12:35:30.376683 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: DEBUG nova.api.openstack.wsgi [None req-8fc662fd-ba08-40ad-a3fc-0990897373ec tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] Calling method '.version_select at 0x7f9917634e50>' {{(pid=121154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 12:35:30.482077 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO nova.api.openstack.requestlog [None req-8fc662fd-ba08-40ad-a3fc-0990897373ec tempest-TestVolumeBootPattern-266125350 tempest-TestVolumeBootPattern-266125350-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1386494864" status: 202 len: 0 microversion: 2.1 time: 0.109270 Aug 12 12:35:30.482651 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: [pid: 121154|app: 0|req: 822/1608] 10.222.0.27 () {58 vars in 1263 bytes} [Fri Aug 12 12:35:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1386494864 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 12:35:42.342213 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:35:42.343107 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Fri Aug 12 12:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:35:44.872420 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:35:44.872958 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:35:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:37:25.472017 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:37:25.472746 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:37:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:39:02.351264 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:39:02.351923 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Fri Aug 12 12:39:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:39:04.881385 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:39:04.881831 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:39:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:40:45.480180 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:40:45.480905 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:40:46.090583 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:40:46.091060 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Fri Aug 12 12:40:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:40:59.119269 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:40:59.119938 dv-cinder-797970-6-iscsi devstack@n-api.service[121154]: Fri Aug 12 12:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 12:40:59.218444 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 12:40:59.218929 dv-cinder-797970-6-iscsi devstack@n-api.service[121153]: Fri Aug 12 12:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!